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groups of Navajo students^ both of whom began school essentially 
monolingual in Navajo. The bilingual group consisted of students from 
Bock Point Community School who had first been taught to read in 
Navajo and then^ at the second grade levels had also been taught to 
read in English. The second group consisted of students from a 
selected sample of BIA schools who had been taught to read in English 
only in English as a Foreign Lanugage (EFH direct method programs. 
The study utilized existing programs in carefully selected schools. 
Students who had received bilingual instruction scored higher on 
standardized achievement tests than did students at comparable 
schools who had received English-language-only instruction and better 
than earlier Beck Point students who had received 

English-lancruacre-only instruction. Also^ the bilingual students who 
were taught arithmetic in Navajo and English until the end of the 
second grade had significantly higher irean scores on the Total 
Arithmetic stJbtests than did the EFL direct method group at grades 
above the fourth* The major portion of the monograph consists of 
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which details the Bock Point Study's methodology^ findings of the 
studyr and a statistical analysis. (CM) 
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Foreword 



When the Bilingual Education Act was passed in 1968, it was essentially con- 
sidered as an experimental approach to the problems of pupils in American 
schools who had limited EngUsh speaking abiUty. Paradoxically, the initial 
intention was not to deal with the problems of such children unless they spoke 
Spanish, and as the program developed, there were even more striking para- 
doxes. Thus, 10 years later we are stiU arguing about the effectiveness and 
the goals of the program. One of the most serious failures that can be 
charged to those responsible for bilingual education over the past 10 years 
has been in the area of evaluation. While a great deal of emphasis was placed 
on demonstration projects, on proposals that specified behavioral objectives, 
and on renewal proposals that reported on the attainment of these objectives, 
there has been virtually no meaningful research or evaluation associated with 
the Title VII program. 

One striking exception has been the mammoth and expensive USOE-sponsored 
short term study carried out by AIR to show that bilingual programs do not 
differentiate as to quaHty and do not appear to lead to marked increases in 
English language ability of their students in a six-month period. 

The research reported in this monograph is not sponsored by the U.S. Office 
of Education. It is the record of a school staff working to monitor some inno- 
vative programs in which they were engaged in order to be in a position to 
assure their school board and the parents of their children that the program 
was educationaUy viable. Even with its Umitations, the study is an excellent 
model of the kind of research we need if we are to understand more about the 
effects of educational innovations. 

It would not be fair for me to give away all the results of the study, but I 
would like to draw attention to a ntimber of the features that make it so valu- 
able. The first is, of course, its longitudinal natvire. As we know from 
large numbers of educational studies, so many factors affect achievement in 
school (and so many of them are not necessarily related to school itself) that 
effects of changes in curriculum will show up only slowly, and when many 
other factors are controlled. The basic curricular question posed for those 
concerned with American bilingual education is whether or not instruction in 
the child's native language is preferable during the time that the child is 
achieving mastery of the standard language, EngUsh. The two approaches, 
referred to by Patricia Engle and in this study as the bilingual method and 
the EFL direct method, each have sufficient justification in theory and prac- 
tice to be considered educationally viable alternatives. The present study 
looks at the effect of these two approaches on the English reading and arith- 
metic scores of Navajo pupils over a six- year period. It shows advantages 
for the bilingual approach in the situation and evidence as to how misleading 
results taken after one year would have been. Its first significance, then, 
is demonstrating that in the study of an innovative educational program we 
need longitudinal rather than short term studies. 
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The study is also significant in making clear the importance of various back- 
ground factors involved in educational studies. The authors do a very good 
job of describing the community and school in which the program took place 
and give a good pictxire of the actual educational innovation. It could well 
be, as they point out, that the special circumstances of their school and of 
its community might ultimately turn out to have been more important contrib- 
uting factors than the particular curriculum. Their description will make it 
possible to draw appropriate conclusions when we have similar studies of other 
school programs. 

A third significant^ aspect to this study is one that gives me as much per- 
sonal as professional pleasure. While I must make quite clear that I have no 
right to claim responsibility for any portion of this present study, I see it as 
the logical fruition of a program of work that I have been engaged in for the 
last nine or 10 years. In 1969, I was asked by some people in the education 
division of the Bureau of Indian Affairs to consider the possibility of some 
kind of replication of the Modiano study using the Navajo situation — to con- 
sider the possibility of a study of the relative advantages of the bilingual 
approach and the EFL direct approach to the Navajo situation. The ./ork of 
the Navajo Reading Study, supported by grants from the Bureau of Indian 
Affairs, the U.S. Office of Education, and the Ford Foundation, focused on 
this goal; we were fortunate enough that all our funding agencies accepted 
our basic premise that no comparison was possible until we had materials and 
teachers capable of implementing a bilingual approach with Navajo. The Read- 
ing Study was involved, therefore, with a great number of preliminary and 
basic studies rather than with the actual research design that is finally demon- 
strated in this present publication. Wayne Holm spent two years at the Uni- 
versity of New Mexico working as a research assistant at the Reading Study 
and writing his dissertation on the topic of Navajo orthography. His work at 
Rock Point School can be seen as a continuation of this project, and the pres- 
ent study is an answer to questions originally (but patiently) posed by people 
at the BIA and the Ford Foundation. Paul Rosier was the bilingual education 
coordinator at Rock Point School. His doctoral dissertation dealing with the 
results of the Rock Point program formed the basis of this monograph. 

If I might venture my own summary of the lesson to be learned from the 
Rock Point bilingual program, it is this: In a community that respects its own 
language but wishes its children to learn another, a good bilingual program 
that starts with the bulk of instruction in the child's native language and 
moves systematically toward the standard language will achieve better results 
in standard language competence than a program that refuses to recognize 
the existence of the native language. In this traditional Navajo community, 
a school under the control of the members of the community has developed bi- 
lingual programs with their approval. Whatever other results there may have 
been (and I refer here, of course, to the community control, to the strength 
of Navajo values, to the continued growth for the pupils in their Navajo lan- 
guage skills), one marked effect has been much greater success in the teach- 
ing of reading in English and arithmetic than achieved by other approaches. 
The study shows a set of circumstances in which a bilingual program appears 
to be meeting the needs of a community better than any other approach. 

Bernard Spots ky 
University of New Mexico 
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Introduction and Summary 



Bilingual education in the United States is enveloped in controversy. Edu- 
cators and noneducators argue about the value, if any, of teaching children 
of limited English speaking ability in their dominant or native language. 

Does instruction in the native or dominant language have any effect, posi- 
tive or negative, on English language development? This question is addressed 
in the monograph which follows. The studies were conducted on the Navajo 
Reservation where approximately 90 percent of the children enter school speak- 
ing Navajo. The primary focus of the monograph is on achievement in English 
reading, particularly how introducing Navajo students to reading in the Navajo 
language affected their later ability to read in English. It also looks at 
achievement in arithmetic and achievement in English language proficiency. 

To do this, we have compared two groups of Navajo students, both of whom 
began school essentially monolingual in Navajo. The bilingual group consisted 
of students who had first been taught to read in Navajo and later, at the 
second grade level, had also been taught to read in English. These students 
continued to receive reading instruction in both Navajo and English through 
the sixth grade, the highest grade then offered at the school. The other 
group consisted of students who had been taught to read in English only in 
monolingual English as a Foreign Language (EFL) direct method programs. 
Existing programs were used in the study. Schools were carefully selected, 
and the programs in all schools had been well established before these studies 
were. undertaken. Consequently, these studies do not purport to be scientific 
experiments; they are studies. of "things as they are" or "were." 

The reading achievement study, conducted from 1975 to 1977, examined the 
effects of initial literacy in Navajo on later reading in English. The Stanford 
Achievement Test (SAT) was the principal instrument used, with the Metro- 
politan Achievement Test (MAT) also used in 1976. Students were tested in 
grades two through six, except in 1975, when only second through fifth 
grade scores were reported. Mean scores for Total Reading and its constitu- 
ent subtests are compared. 

The arithmetic achievement study examined the effects of initial arithmetic 
instruction in Navajo on later arithmetic in English, and it involved the same 
groups as the reading achievement study. Only the SAT tests for grades two 
through five for 1975 were compared. Mean scores for Total Arithmetic and 
its constituent subtests are compared. 

The English language proficiency study studied the effects of reduced Eng- 
lish language instruction time on English language proficiency. The Test of 
Proficiency in English as a Second Language (TOPESL) was used with the bi- 
lingual group students in 1975 and 1976. The mean scores on the two sub- 
tests administered are compared with mean test scores for the EFL-only group 
in 1974. Only grades four through six were tested. 

The bilingual method school in this monograph was Rock Point Community 
School. The reading and arithmetic studies compared achievements of Rock 
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Point students with achievements of students in a selected sample of Bureau 
of Indian Affairs (BIA) schools. These schools comprised the EFL direct 
method group or Area sample. The English language proficiency study com- 
pared Rock Point student achievement with the achievement of students in all 
or most of the Bureau of Indian Affairs schools on the Navajo Resei-u^ation. 

Rock Point is a community controlled "contract" school on the Navajo Reser- 
vation. As a contract school with a largely nondegreed staff and an atypi- 
cal, bilingual curriculum, the school ha^ had to become evaluation conscious 
to survive. 

The senior author was the schooPs Title VII (bilingual education) coordina- 
tor from 1973 through 1975, a doctoral candidate (1975 through 1977), and, 
more recently, assistant director of the Native American Materials Development 
Center. The junior author was the schooFs principal when it was a Bureau 
school and has been its director since the school "went contract" in 1972. 
This monograph has its origin in Rosier's doctoral dissertation, "A Compara- 
tive Study of Two Approaches of Introducing Initial Reading to Navajo Chil- 
dren: The Direct Method and the Native Language Method" (Rosier, 1977). 
The dissertation focused on achievement in reading in English, as tested with 
the Stanford Achievement Test (SAT) at Rock Point and at selected Bureau 
schools during a three- year period (1975 through 1S77). 

The senior author sought and obtained the assistance of the Navajo Area 
Education Office. They were most cooperative, as was the academic leader- 
ship of those Area schools that agreed to participate. The SAT was adminis- 
tered only once in these schools, in February of 1975. Some gaps were later 
found in the data; these are not extensive and have been noted in the text. 
Every effort was made to analyze the available data in a rigorous manner. 
This monograph makes use of additional data, which has not been as rigor- 
ously analyzed as that in the dissertation. 

Although this monograph depends almost entirely upon standardized achieve- 
ment test data, the subject school—Rock Point—does not rely very heavily on 
such data. The school's evaluation activities center on the ongoing adminis- 
tration of locally developed criterion-referenced tests, with copies of the re- 
sults going directly to the responsible classroom teachers. Standardized 
achievement test results are required as part of the formal evaluation of the 
"Main" (BIA) contract and the Title I and Title VII grants. The school has 
little faith in, and makes almost no use of, individual test scores; it has some- 
what more confidence in group or grade means for 20 or more students. 
Despite cultural and language differences between Rock Point students and 
those students with which these tests were normed, it is useful to learn, once 
a year, where the school stands vis-a-vis national norms. In a sea of 210 
million people, 160,000 Navajos are a small language island.'- We feel that 
those reservation educators who would substitute "Navajo norms" for "national 
norms" are deceiving themselves. 

There is probably some transfer from specific criterion- referenced tests 
(many of which are administered individually) to standardized achievement 
tests (which are group administered), and, as a result. Rock Point stufl^nts 
may be somewhat "testwise." The school is touchy, however, about accusa- 
tions that they "teach the test." In most Navajo Area schools, achievement 
tests have been administered by the classroom teacher, a practice which 
Eugene Brifere^ has said (orally) tends to elevate scores by as much as one 
standard deviation. At Rock Point, such tests are administered by nonclass- 
room teachers, and area observers are invited to monitor test administration. 
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We are rather skeptical of the textbook educational research design which 
purports to compare the effects of "treatment X" to those of "treatment Y" 
while "controlling" aU other "variables." Education involves groups of people 
in interaction and, consequently, the variables are too many and too complex 
to be completely "controlled." In our use of the term, "control" group should 
be understood to refer to "the group of those students (who took the tests) 
from the sample of otherwise comparable Bureau schools with EFL direct 
method programs." 

We have tried to design an honest study. We selected some of the better 
Bureau schools for comparison, and we continued to have tests administered 
by persons other than the classroom teacher, despite the fact that teachers 
usually administered the tests to their own students at the Area schools. We 
have described the experimental situation as carefuUy and objectively as we 
as participants, could. We have presented the data with consideration for 
fairness—combining three years of Rock Point means to minimize year-to-year 
differences; omitting Rock Point's sixth grade arithmetic scores, although 
favorable to Rock Point, because of the small number of students involved; 
and noting gaps in the data where these exist. Finally, we have noted alter- 
native conclusions to the data and, where we could, adduced additional data 
to show why we retain the conclusion stated. 

The major results may be summed up as follows. Despite the fact that they 
did not begin reading in EngUsh until midway through the second grade, the 
bilingual group had statistically significant higher mean scores on the SAT sub- 
tests for Total Reading than did the EFL direct method group at all grades 
above the third. Similar results were obtained with the MAT subtests for 
Total Reading. 

Also, the bilingual students, who were taught arithmetic in Navajo and Eng- 
lish until the end of the second grade, had statistically significant higher 
mean scores on the Total Arithmetic subtests than did the EFL direct method 
group at gn^ades above the fourth. At each higher grade, the bilingual 
group s mean scores for Total Reading and the Total Arithmetic tended to 
diverge further from those of the EFL direct method group and converge 
closer to those of the national norms. 

Rock Point fourth graders who had received continuous bilingual instruction 
did better on SAT Total Reading subtests than did Rock Point fourth grade 
students who had received interrupted biUngual instruction. Despite the fact 
that most of their Rock Point teachers were nondegreed. Rock Point sixth 
graders, most of whom had received biUngual instruction, did better on the 
1977 SAT Total Reading subtests than the Rock Point sixth graders, who re- 
ceived intensive EFL direct method instruction from degreed teachers, had 
done in 1970. And despite receiving less daily exposure to instruction through 
Enghsh, the bilingual group's mean scores on subtests of the Test of Pro- 
ficiency in English as a Second Language were markedly higher than those of 
the EFL direct method group. 

We cannot daim to have proved anything as abstract as "bilingual education 
IS better than. ..." We have attempted to show that at Rock Point, Navajo 
students who had received bilingual education did better on standardized 
achievement tests than did Navajo students at comparable schools who had 
received English-language-only instruction; they also did better than earlier 
Rock Point students who had received English-language-only instruction. 
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NOTES 

1. A "contract" school is one where a tribe or tribal organization has con- 
tracted with the Bureau of Indian Affairs to operate a previously federal or 
private (nonfederal) school under the terms of PL 93-638. 

2. The Navajo population figure of 160,000 is the 1979 figure. No other 
statistics have been updated from their 1977 level. 

3. Eugene Bridre, personal communication. 
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Overview of the Navajo Situation 



THE NAVAJO TODAY 

The Navajo^ are an Athabaskan speaking people living in the southwestern 
United States. About 160,000 live on or near the West Virginia-sdzed reserva- 
tion in New Mexico, Arizona, and Utah. They are the largest Indian tribe in 
the United States. The reservation is also the largest in the United States, 
but it is not capable, at this time, of providing an adequate living for *.he 
people. Today, as individuals, Navajos are (on the average) among the poor- 
est Americans. 

The reservation is badly overgrazed. Rainfall is scant and the development 
of the major source of water for irrigation, the San Juan River, is just begin- 
^^S- Despite development of mineral /fuel extraction and energy related activi- 
ties, expansion of federal service jobs and job development activities, and at- 
tempts to develop light, waterless industrial activities, the regervation seems to 
be drifting farther from, rather than toward, economic self-sufficiency. 

For most Navajos, sustained contact with the Anglo socioeconomic world came 
relatively late—with or since World War II. Mass education came even later. 
As late as 1948, only half of the Navajos between the ages of six and 18 were 
in school. Only since 1953 has there been what might be considered near- 
universal education. 

Given the relatively large land base, the relatively large population, and the 
late arrival of near-universal EngUsh language education, the Navajos are the 
largest Native American language island in the United States. Navajo is still 
the language of two out of three homes; about 90 percent of the children 
entering school are monolingual or dominant in Navajo. Bilinguals are increas- 
ing, but with the high birthrate and the relatively high incidence of the use 
of Navajo at home, the number of Navajo speakers is stiU increasing. Navajo 
is not a dying language! 

NAVAJO EDUCATION SYSTEMS 

The original schools on the reservation were boarding schools, generally 
located at government administrative centers—the "Agency" headquarters. 
During the mid 1930s, the Bureau of Indian Affairs built some 50 community 
day schools on the Navajo Reservation which became the infrastructure of the 
Navajo education system (Thompson, 1975). 

During World War II, therp was a shift to community boarding schools; after 
the war, to large on- and off- reservation boarding schools. With postwar em- 
phasis on integration, relocation, and termination, government funds made 
possible massive reservation -wide construction of both public schools for day 
students and Bureau boarding schools. Thus, the peculiar arrangement of 
multiple, overlapping school districts and systems came about. 
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Today, there are about 60,000 Navajo children between ages five and 18. 
An increasing number, approaching two- thirds, of these children now attend 
public schools. A decreasing number, roughly one-third, now attend BIA 
schools; most of these students are unable to attend public schools on a day 
basis because of poor roads. Smaller numbers of children attend community 
controlled contract schools, mission schools, and other special purpose 
schools . 

The basic nonbiological social unit above the extended family is the "com- 
munity." The Tribe recognizes 102 such communities, politically organized as 
Chapters. Although the Bureau schools of the 1930s were basically one-com- 
munity schools, today most public and Bureau schools do not serve single com- 
munities. Public schools tend to be located in off- reservation or emerging on- 
Reservation towns. Bureau schools, compensating for the loss of day students 
to the public schools, tend to draw boarding students from communities farther 
away. Most schools- -public and Bureau--draw students from a number of com- 
munities, and most communities send students to a number of schools. 

Public school boards tend to be made up of professionals from the off- 
reservation or emerging on-reservation towns; they must work within the sys- 
tem of the Anglo-oriented state school system. The Bureau school boards are, 
by their constitution, strictly advisory. (Or they were at the time this was 
written. Legislation passed by the 95th Congress will increase the powers of 
these boards without giving them "control" of their schools.) Thus, rural 
Navajo community people have relatively little influence on the education of 
their children in Bureau or public schools. 

Navajo children have not, as a group, done particularly well in school. The 
reasons for this are many and go beyond serious basic problems of finances. 
This does not mean that all schools and all students do poorly; there are stu- 
dents who do well. Most Navajo parents do not realize just how low Navajo 
"norms" are. It is doubtful that there will be significant action to improve the 
quality of education until parents become more aware of the real situation. 

Table 1 displays a comparison of Navajo Area student achievement with the 
national norms in second through sixth grades in 1972, using Stanford Achieve- 
ment Test results. ^ 



Table 1. A Comparison of Navajo Student Average Achievement Scores and 
the National Norms on the Paragraph Meaning Subtests of the 
Stanford Achievement Test.* 







Average Grade-level 




Grade 


National 


Eqviivalent for 


Difference 


Level 


Norm 


Navajo Students 


Minus /Plus 


Second 


2.5** 


1.8 


.7 


Third 


3.5 


2.4 


1.1 


Fourth 


4.5 


2.7 


1.8 


Fifth 


5.5 


3.6 


1.9 


Sixth 


6.5 


4.1 


2.4 



*The document cited does not give the number of students involved in the 
testing, but it is assumed that at least 5, 000 students were tested. 
**The National Norm is determined by the date of the administration of the 
test. The test was administered in February, 1972. 
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Navajos call public schools bilagaana yazhi bi'olta', "Anglo(s) /little/ 
school(s)."^ The proportion of non- Navajo students may range from a 
few to a ra*ajority depending on location. The Navajo students tend to enter 
pubUc schools speaking more EngUsh than do students in Bureau schools, but 
It appears that these initial language advantages are not being translated into 
demonstrated advantages on achievement tests (Spolsky and Holm, 1971 and 
Appendix A). Until recently, there have been very few Navajo teachers. 
The Navajo Division of Education estimates that there are only a few hundred 
Navajo teachers on the reservation serving the school-age population. 

Monolingual and Bilingual Programs 

The Navajo Area had a relatively sophisticated word control approach to 
teaching English on the reservation in the late 1930s and early 1940s. This 
w^ lost in the rapid postwar expansion of the Bureau school system in the 
1950s. The Navajo Area began putting heavy emphasis on English as a 
Foreign Language (EFL) training and materials development only in the late 
1960s. (English as a Foreign Language seems to be the most appropriate 
term for programs designed to systematically teach EngUsh to non-EngUsh 
speakers [Holm, 1973].) It is our impression that, despite continued training 
and materials development, EFL programs are, at best, school level programs 
—some schools have good EFL programs, most do not. Public schools tend to 
have more non-Navajo and EngUsh speaking Navajo students; therefore, they 
have tended to perceive EngUsh as less of a problem and EFL approaches as 
less appropriate. 

The Navajo Area has had several EFL direct method programs developed 
specificaUy for Navajo children. These programs have been refined and organ- 
ized into two curricular approaches that are presently used in Area schools. 
Consultants In Total Education (CITE) and the Navajo Area Language Arts 
Program (NALAP) materials are used in many of the Area schools on the 
Navajo Reservation in grades one through three. 

The approaches mentioned to this point have all been monoUngual EngUsh 
programs in which EngUsh is the onZy language of instruction. In the late 
1960s, an alternative approach was introduced on the reservation; it incor- 
porated EFL as one component and instruction through Navajo as the other 
component, thus forming a bi Ungual approach. (We make the distinction be- 
tween teaching Navajo and teaching in or through Navajo. At Rock Point, 
Navajo is used as a means of instruction. While no doubt the students are 
learning more adult Navajo, the subject matter is reading, arithmetic, Navajo 
social studies, etc. , not the acqmsition of Navajo. The role of Navajo is com- 
parable to that of EngUsh in EngUsh-only classrooms.) 

Continuous Navajo text was written as early as the 1890s and there seems 
to have been some use of written Navajo before World War 1. A good, practi- 
cal orthography has been available since 1940 when some materials also were 
developed. However, there appear to have been no school- wide biUngual 
education programs before the estabUshment of the Rough Rock Demonstration 
School in 1966. 

Most Navajo students still arrive at school speaking relatively Uttle (or no) 
EngUsh, and most are taught in EngUsh by non-Navajo speaking teachers. 
Some students are taught EngUsh as a foreign or second language, but very 
few are taught in Navajo. In a small number of schools—public. Bureau, con- 
tract, and mission — efforts are being made to teach in Navajo. 

The EFL direct method (the term is Engle's; see Engle, 1975) approach in- 
troduces the child to EngUsh using oral-aural techniques. After a certain 
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proficiency in English has been developed, usually after the first year, read- 
ing and arithmetic are introduced in and through English. EFL-related tech- 
niques are used to teach reading; vocabulary, spelling patterns, and syntacti- 
cal structure are controlled. Ideally, the EFL oral language activities and the 
EFL controlled reading techniques continue to be used until the child becomes 
a proficient speaker and reader of English e 

The bilingual approach introduces reading in the native language first. 
Reading in English begins after the child has become a proficient reader in 
the native language, at the second or third grade level. Most of the essen- 
tial concepts of reading should transfer from reading in Navajo to reading in 
English. EFL instruction is provided while the child is learning to read in 
the native language. The bilingual method allows children to learn to read in 
the language they understand while developing proficiency in the other lan- 
guage. All other content subjects taught in the program, including arithmetic, 
are introduced in Navajo. Arithmetic concepts are taught in Navajo; the Eng- 
lish language needed for arithmetic in English is introduced later, as a special- 
ized sort of EFL. 

Which Approach? 

Both approaches are designed to help the child become a competent English 
speaker. Both have as one of their goals the proficient development of the 
basic skills of reading, writing, and arithmetic. The bilingual approach, how- 
ever, is also intended to develop abilities in Navajo not addressed by the EFL 
direct method approach. We do not mean to minimize these; we feel they are 
very important. We woxild say that a bilingual program in which students do 
as well in English as students in a monolingual program,' and also do things 
well in Navajo not done by students in the monolingual program, has done 
more and has done better than the monolingual program. But this monograph 
is intended to address the more limited question posed by "hard-headed prag- 
matists:" what are the effects of bilingual instruction on achievement (as 
measured by standardized achievement tests)? 

The problem for Navajo educators is which approach allows Navajo children 
the best opportunity to develop English language proficiency and competence 
in basic skills, reading, and arithmetic to their greatest extent. The purpose 
of this study was to determine the effects of each of these two approaches on 
the development of English reading ability, English-mediated arithmetic ability, 
and overall English language proficiency. (See Appendix A for literature 
pertinent to this problem.) 

NOTES 

1. The spelling Navaho occurs in some of the anthropological literature; 
the older Spanish spelling Navajo is the one sanctioned by the Tribal Council 
and will be used here except in citing titles with the other spelling. 

2. Results of Stanford Achievement Test, 1972. From the Navajo Area 
Office, Bureau of Indian Affairs, Window Rock, Arizona, June 9, 1973. 
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THE EFL DIRECT METHOD SCHOOLS 

The seven schools that served as the EFL direct method sample group in this 
study were all Navajo Area schools. Bureau schools were chosen because 
their student populations were considered to be more like that of the bilingual 
method school, and because they had somewhat comparable EFL programs. 

The Navajo Area is the Bureau administrative unit roughly comparable to 
the Reservation as a whole. For administrative purposes, the 19 grazing dis- 
tricts of the Area are divided into five "Agencies." Rock Point Community 
School — the bilingual method school — is, for educational purposes, under the 
Chinle Agency. The terms "Area" and "Agency," as used in this study, re- 
fer to the Navajo Area and the Chinle Agency, respectively. 

The seven Bureau schools were selected after consultation with Area educa- 
tion specialists. All seven had structured EFL programs; all had programs 
which involved a second adult (however designated) in instruction in at least 
the kindergarten through second grade classrooms. These schools were con- 
sidered, by knowledgeable people in the Area education offices, to be among 
the best of the Area schools at the time, i.e. an honest effort was made to 
compare the results of the Rock Point program with those of the best of the 
Area schools. 

THE BILINGUAL METHOD SCHOOL (ROCK POINT) 
Background 

Ts6 Nitsaa Deez'ahi ("Rock/it-is-large/it-extends-horizontally , the one 
that") is a Navajo community of about 1,400 people on either side of the 
middle reaches of Chinle Wash in far northeastern Arizona. The community 
is relatively poor, even by reservation standards. Almost all of the district 
in which Rock Point is located has been badly overgrazed. Water for irriga- 
tion from Lukachukai Wash or Chinle Wash is available in some years and not 
in others. There were, until recently, few high school graduates and virtu- 
ally no college graduates from the community. Before the advent of more ex- 
tensive government financed work and training projects, most Rock Point men 
worked off- reservation in short term work such as railroad "steel" gangs, 
forest firefighting, seasonal farming, and mining. 

The Bureau built a small two- teacher day school near the trading post in 
the mid 1930s. Surviving World War II, when a number of schools had to be 
closed, the school was expanded to become a three- teacher community board- 
ing school in 1953; both day and boarding students attended. Since children 
completing second or third grade at Rock Point had to go to Chinle (50 miles 
away) to continue their education, the Chapter (the community level political 
unit) formed an Education Committee to urge enlargement of the school at Rock 
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Point. As a result of the Committee's efforts, the school was enlarged in 
1963-1964. In 1964 the school undertook an intensive school-wide EFL pro- 
gram, one which was eventually adopted by the Navajo Area. In 1967, the 
local Education Committee chose to put their first meager supplemental funds 
(Title I) into a modest initial literacy in Navajo activity for six-year-old be- 
ginners. Through the committee's continuing efforts, the school was enlarged 
a second time in 1967-1968. The Tribal Council formally organized Local 
Navajo Community School Boards in 1969, and in 1971, the Board sought and 
received Title VII (bilingual education) funding for bilingual education activi- 
ties. 

The following year, the Board obtained its first contract with the Bureau to 
operate the entire school, and the school is now in its seventh year of con- 
tract operation. A basically uneducated, monolingual Navajo School Board man- 
ages a combined budget in excess of 1.8 million dollars (FY78), interviews and 
hires (and fires) employees, and makes all major policy and financial decisions. 

The Educational Program 

The. school's basic education program involves coordinate bilingual instruc- 
tion: separation of language by speakers. Navajo Language Teachers (NLTs) 
teach in Navajo; English Language Teachers (ELTs) teach in English. Both 
NLTs and ELTs plan and teach their own lessons; NLTs are teachers, not 
aides. Overall team planning is done together. 

The kindergarten has a team of two NLTs and one ELT. The NLTs teach 
Navajo reading readiness and arithmetic in Navajo in separate parts of the 
classroom and, jointly, Navajo social studies. The ELT teaches EFL and arith- 
metic in English. In each of the next six classrooms, beginner (six- year-olds 
who have not taken part in, or have not completed, kindergarten) through 
second grade, there are two- teacher teams, NLTs and ELTs, teaching at 
opposite ends of the rooms. NLTs teach Navajo reading, arithmetic in Navajo, 
and Navajo social studies, which involves topics selected by the Board, with 
heavy concentration on the Navajo clan and kinship systems. The ELTS teach 
EFL and arithmetic in English. English reading is added in the second grade. 
Thereafter, children read in both languages. 

In classroom grades three through six there is a single teacher, an ELT. 
The classroom ELT teaches reading (in English) and arithmetic (in English). 
Students leave the room throughout the day in half-class groups for pro- 
grammed reading, Navajo literacy, and either science in Navajo or Navajo 
social studies (one semester of each). Health is taught (in English) once a 
week. (The school has since added junior high grades which were not in- 
volved in the study. Bilingual instruction has continued in the junior high.) 

The program could be characterized as a maintenance program with a pro- 
gressive shift towards English. In the kindergarten, about 70 percent of the 
instruction is in Navajo; in the primary classrooms (beginner through grade 
two), about 50 percent is in Navajo; in the elementary grades (three through 
six), about 20 percent is in Navajo; and in the junior high, perhaps 15 per- 
cent of the instruction is in Navajo. 

The school has attempted to develop an integrated education and student 
care program with multiple funding sources. The School Board has, in pro- 
posals, stated that their goal is the continued development of quality Navajo 
education through increased community management and control. Bilingual 
education is not a component of, or an adjunct to, the education program; 
bilingual education is the education program. The Board has tended to 
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structure the school toward this end— activities which are not felt to con- 
tribute directly to a bilingual curriculum have been modified or eliminated. 

Supporting Features 

Selection, Development, and Training of Teachers. Th^ School Board has 
come to see the development of teachers from the community as the only way 
a rural Navajo community can attract and retain a stable staff. All NLTs are 
Navajos, most from the Rock Point community. An increasing number of the 
ELTs are Navajo—roughly , three-quarters by 1978. Most Navajo teachers do 
not have, but are working toward, degrees. Teachers at Rock Point are 
carefully selected and go through extensive screening procedures. The School 
Board interviews job applicants meeting minimal standards. Since local people 
without degrees or prior training have been hired and are being hired to 
teach in the bilingual program, an intensive and extensive training program 
has had to be developed. This program consists of half-year internships, 
periodic in-service training, on-going demonstration teaching, and formal 
college courses taught by local as well as university instructors. 

The training program for NLTs has concentrated on teacher literacy (teach- 
ing prospective teachers to read and write Navajo) , methodology for teaching 
Navajo language arts, and methodology for teaching content subjects in 
Navajo. The needs of ELTs are different but have also required an inten- 
sive training program. The Rock Point administration has assumed that most 
college trained teachers are not prepared to teach in a situation like Rock 
Point. Therefore, an in-service program was developed to train both local 
and college trained ELTs techniques for teaching in a second language situ- 
ation. The training includes emphasis on TEFL oral language techniques and 
on TEFL techniques for teaching reading, writing, and content subjects. 

The training program that has evolved combines on-site coursework at Rock 
Point during the school year with on-campus coursework at Northern Arizona 
University in the summers. By the fall of 1977, 16 people had completed 
Bachelor of Science degrees (only two or three community people have man- 
aged to earn degrees in Education in the conventional manner). Although 12 
of these graduates have remained at Rock Point, most have moved into special- 
ist or administrative roles, leaving the school with a majority of nonde greed 
classroom teachers. It is important then, in reading this study, to remember 
that the Rock Point results are the work of a largely nondegreed, noncerti- 
fied, Navajo staff. 

The Structure of the Curriculum. The program at Rock Point is highly 
structxured in both languages—particularly in English. The English language 
curriculum is designed to teach English as a foreign or second language. 
Both structural and situational approaches are used, with emphasis on a 
structural, sequential approach. English is introduced in small, systematic 
steps beginning with simpler structures. 

Content subject matter is not introduced in English until second grade, and 
it is limited to the content in the English readers used in the English reading 
program. The English language curriculum from third through sixth grade is 
limited to the subject areas of language arts, arithmetic, and some social 
studies. The emphasis at these levels is still on teaching English as a foreign 
or second language with somewhat more relaxed TEFL-derived techniques em- 
ployed in all content areas. 

The Navajo language program is also basically highly structured. There 
were no precedents available at the time for a Navajo language curriculum or 
learning- to- read materials. There was, and is, a growing body of Navajo 
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language reading materials by the Bureau, Rough Rock, the Navajo Reading 
Study, Sanostee, and others, but Rock Point was forced to develop materials 
to teach initial reading in Navajo and arithmetic in Navajo. The curriculum 
and materials developed were, of necessity, relatively simple and rather 
mechanically structured. There were also no precedents for teaching in 
Navajo or training teachers in Navajo (training tended to focus concretely on 
how to teach the materials developed or available at Rock Point) . 

The English language and the Navajo language curricula are coordinated. 
Concepts taught in Navajo tend to be many of the same concepts that will be 
needed later in English. The reading systems are similar, using a so-called 
linguistic approach with both languages. The same arithmetic program is 
used in both languages in the primary grades. Arithmetic lessons are taught 
first in Navajo and later are repeated in English. Navajo social studies and 
science in Navajo, however, are taught only in Navajo. 

Behavioral objectives and criterion-referenced testing have been established 
for both languages , and children are tested regularly to determine if the ob- 
jectives are being met. Students' and groups' progress is monitored fre- 
quently, and the school is viewed as mastery-oriented. 

Despite the fact that this monograph depends almost entirely upon stand- 
ardized achievement test data, the school itself does not rely very heavily on 
such data. The heart of evaluation activities at the school is a slowly chang- 
ing body of criterion- referenced objectives for both Navajo and English activi- 
ties. A Navajo Language E valuator and an English Language Evaluator (both 
of whom have other duties as well) administer such tests upon request from 
classroom teachers. Itinerant Teachers (in both languages) are assigned to 
work with some of the students who failed or missed a given test. 

Materials Used in the Program. Most of the materials used in the Rock Point 
program are either specifically designed for Navajo children or for general 
EFL. Commercially available materials intended for native English speakers 
are modified for use with Navajo children. Although the content of the Eng- 
lish language readers is not related to Navajo life, the Navajo language read- 
ing materials do generally focus on aspects of Navajo life, and the Navajo 
social studies materials focus on aspects of Navajo culture. Consequently, 
children are reading about and discussing things in Navajo that are, or 
should be, familiar. 

Teachers are trained to use these materials through intern, in-service, and 
demonstration activities. 

School Tradition. A tradition of high expectations has developed at Rock 
Point: children are expected to succeed. The largely Navajo teaching staff 
refuses to accept the common stereotype that Navajo children are '^not inter- 
ested in learning, passive, nonverbal, silent." Both the teaching and dis- 
cussion techniques used in Navajo and the TEFL techniques used in English 
require students to talk, and they are expected to interact verbally in these 
and other learning activities. 

The school feels that this approach reflects the wishes of the community 
since Rock Point is a community with high academic and behavioral expecta- 
tions of their children. The community Parent Evaluation Committee tends to 
be critical of school employees who do not insist on high standai'ds of atten- 
tiveness and behavior. Some outsiders have suggested that the school itself 
has created these expectations; the school, however, tends to understand this 
as older (more traditional?) Navajo expectations of responsible child behavior 
transferred from the home to the school setting. 

Leadership of the School. A key element coordinating all the variables pre- 
viously mentioned seems to be leadership. A number of the people have been 
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wth the school for 15 years or more. The same is true of the Board i e 
the current vice president has served for 20 years—since the Board's in- ' 
ception. This degree of continuity and cooperation toward commonly ac- 
cepted goals IS unusual in an area characterized by rather high professional 
turnover and consequent changes in direction. 

LIMITING FACTORS ON THE STUDY 

The environment of most of the students in this study must be described as 
essentially monolin^al-monocultural. ^ GeneraUy. children enter school speak- 
ing only Navajo and have Uved primarily in the contemporary Navajo cultural 
f^r^u^"^ \* This situation must be taken into consideration when interpret- 
ing the results that follow because they may have limited appUcation to chil- 
dren living m other language and ctdture situations. 

The EFL direct method implies that the EFL oral language program and the 
reaoing program are coordinated and make use of similar language structure. 
The programs of the Navajo Area schools in this study differ in the degree of 
coordination of EFL oral language and reading as weU as the degree to which 
these curricula are followed. It is not possible to daim that every classroom 
used a similarly coordinated EFL language and reading program. 

Bilingual education is a total curricular approach to providing a learnine 
.environment for children who are bilingual or who must become bilingual. 
Many children enter school as monolingual non-English speakers , and it is 
the school's responsibiHty to help these children become biKngual. This mono- 
graph examines only some of the cognitive aspects of these programs. Al- 
though cognitive subjects are essential curriculum components, other aspects 
of bilmgual education must be investigated before the total effects of bmneual 
education can be assessed. e"*" 

A random sample of schools or students was not possible for this study 
AH schools were selected according to curricular criteria. Only one schocil 
had developed a bilingual program to the extent that children had become pro- 
ncient readers in Navajo before beginning English reading; thus, the bilingual 
group was limited to that school. The Area sample schools were Umited to 
those schools that had established EFL direct method (NALAP, CITE, or other 
TESL curricula) programs. Also, the bilingual sample size was relatively small 
at some grade levels (e.g. the smaUest sixth grade sample analyzed contained 
11 students). Although this sample size was small, it was adequate for com- 
paring means with a T-Test (McCall, 1975). 

The populations of the Area sample schools were not completely consistent. 
Three of the schools, which had their own primary grade program, also re- 
ceived students from small primary grade "feeder" schools at the third and 
fourth grade levels. Although the Area Education Office recommended that 
aU Area schools use either the CITE or NALAP materials, ^ the extent of imple- 
mentation and the quality of instruction may have varied from school to 
school, and many of the transfer students above the third grade level may 
have received somewhat different instruction. This may have had a negative 
effect on the three schools' student achievement scores and affected the over- 
all scores of the control groups at the intermediate grade levels. 

Theoretically, there are as many approaches to reading in Navajo as there 
are in any other language. Since only one bilingual school was involved, this 
study IS limited to that one method—what might be described as a Unguistic 
method— of introducing initial reading in Navajo. In addition, bilingual educa- 
tion for Navajo children is a recent innovation, with the earliest initial literacy 
m Navajo programs for Navajo children dating back to 1967. At that time 
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there were less than 25 texts in Navajo and no children's materials for learn- 
ing to read in Navajo. Even recently there were fewer than 150 texts in 
Navajo and only one set of fully developed initial reading materials. These 
conditions must be taken into consideration with the study. 

Finally, bilingual education has implications beyond the classroom. Spolsky 
has pointed out that bilingual education is influenced not only by the educa- 
tional and linguistic aspects of the situation but also by some of the socio- 
logical, psychological, economic, political, and religious aspects of the situ- 
ation (Spolsky et al. , 1974). The decision to implement bilingual instruction 
must be made after considering all major aspects of bilingual education. Al- 
though academic achievement is only one of the implications of such a decision, 
this study is limited to the classroom and to academic achievement. 

NOTES 

1. Of course, such terminology is relative. There is no doubt that Navajo 
schoolchildren today are much more influenced by Anglo culture (and the Eng- 
lish language) than were students of 10 or 20 years ago. Even so, there is 

a much higher degree of "language insulation" and cultural self-sufficiency 
than most American bilingual educators, working with urban Chicano students, 
know. 

2. Ernest Magnuson, personal interview , March 21, 1977. 
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THE DESIGN 

The focus of the study was on the use of Navajo as a medium of instruction in 
the classroom. Using a comparative design, we examined the effects of intro- 
ducing reading in Navajo on English language reading achievement, the effects 
of teaching basic arithmetic concepts in Navajo on English language arithmetic 
achievement, and the effects of reduced instructional time in English on over- 
all EFL achievement. 

Seven BIA schools made up the EFL direct method groups, or Area sample. 
One group of five schools was used for the Stanford Achievement Test (SAT) 
comparisons and another group of five schools was used for the MetropoUtan 
Achievement Test (MAT) comparisons; three schools were in both groups. The 
schools were considered to be among the better Navajo Area schools, and they 
were selected because (a) upon entering these schools, the children had simi- 
lar Unguistic backgrounds to the Rock Point children when entering school; 
(b) they had well established EFL programs; (c) they had at least two instruc- 
tors in each classroom from kindergarten through second grade; and (d) they 
aad at least one instructor per classroom with native competency in Navajo. 

Reading was most extensively examined. Children were tested mid-year 
(February) in grades two through six with the Stanford Achievement Test. 
The students in the Area sample group were tested once in 1975. The Rock 
Point students were tested in 1975, 1976, and 1977. Each year's Rock Point 
mean scores were compared to those of the Area sample scores. Tn 1976, 
both groups were tested with the Metropolitan Achievement Test. 

The SAT was also used in the arithmetic achievement study, and arithmetic 
subtests were administered in 1975 to all students in both groups, second 
through sixth grade. The data involved in both the reading and arithmetic 
studies were statistically analyzed with a T-test of differences in group means. 
The level of significance was established at .05. 

The study of English proficiency involved a comparison of Rock Point mean 
scores and the Area mean scores (for all students tested in the Navajo Area) . 
The test administered was developed by Eugene Bridre for the Bureau and is 
referred to by the acronym TOPESL—Test of Proficiency in English as a 
Second Language. The TOPESL test was designed to measure English lan- 
guage competency of American Indian children who are non-native speakers of 
English. The test was administered in all Area schools in grades four through 
six in 1974. Rock Point administered the test in 1975 and again in 1976. The 
Rock Point results for each year were compared to the 1974 BIA data. The 
data are presented for visual analysis; no statistical analysis was performed. 
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BASIC DATA 

This section presents the study^s basic data—a set of comparisons of scores 
on the standardized achievement tests. Statistical analyses of the reading 
scores are to be found in Rosier (1977). Three sets of data are presented: 

(1) A comparison of Navajo Area sample mean scores with the grand mean 
scores of the bilingual students for Total Reading and for the Word Study 
Skills and the Reading Comprehension subtests (SAT) is shown for each 
grade level two through six. ("Grand mean score" refers to an average of 
accumulated Rock Point student achievement scores from 1975-1977 at each 
grade level.) 

(2) A similar comparison of mean scores for Total Arithmetic (SAT) is given 
for each grade level two through five. Mean scores on the Arithmetic Con- 
cepts and the Arithmetic Applications subtests for the EFL-only students and 
for the bilingual students are compared and some differences are noted. 

(3) A comparison of the EFL-only mean scores with the bilingual grand mean 
scores for the English Structure and the Listening Comprehension subtests of 
the TOPESL are given for each grade level four through six. 

Reading Achievement 

Charts 1, 2, and 3 (see pages 31-32) depict the results of the reading com- 
parisons. The three years* data collected at Rock Point have been averaged 
and are compared to the 1975 Area sample student achievement scores. The 
Total Reading chart (Chart 1) displays the overall pattern of the data. 

According to these comparisons, the Rock Point students scored about two 
grade-level-equivalent months^ below the Area sample students at the second 
grade level; statistically this difference was not significant. At the third and 
fourth grade levels, the Rock Point students generally scored somewhat higher 
than the Area sample students in the same grades. Many of the comparisons 
were significant at the fourth grade level, and the differences at the fifth 
grade level were significant in all comparisons — the Rock Pcnnt students scored 
1.6 grade-level-equivalent years higher than the Area sample students. Their 
average score of 5.1 was approximately four months below the national norm. 
At sixth grade level all comparisons again were significant — the Rock Point 
sixth graders scored 2.0 years higher than the Area sample students, and 
their average score of 6.2 was only three months below the national norm. 

The Word Study Skills chart (Chart 2) and Reading Comprehension chart 
(Chart 3) display the data for these subtests. Their patterns follow that of 
Chart 1, with students at Rock Point scoring near grade level on these sub- 
skills at the fifth and sixth grade levels. The MAT test results followed the 
same pattern, but both groups scored lower on the MAT than on the SAT. 

The differences between bilingual and EFL-only means for the two subtests 
might be noted. The data is drawn from Charts 2 and 3. The differences 
for the Reading Comprehension subtest are not as great as those for the Word 
Study Skills subtest. 

The Paragraph Meaning or Reading Comprehension subtests require students 
to select one of four given words to fill a given blank in a single- or multiple- 
paragraph text. Students may draw upon their knowledge of word meaning, 
word form, agreement, sentence grammar, story sense, and cultural back- 
ground in selecting an answer. 

The Word Study Skills subtest requires students to select words with the 
same sound in a given position despite different spellings. Table 2 shows a 
difference of only 1.73 grade- eqi:dvalent school years between Area sample 
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second and sixth graders, and many Area teachers have concluded that word 
study skills simply cannot be taught. 



Table 2. 



Word Study SkiUs 
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Rock Point 
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2.05 


2.25 


2.78 
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78 
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Difference 


-.18 


+.17 


+ .32 


+1. 


37 


+1.53 



The Rock Point results suggest otherwise: there is a difference of 4.18 
grade-^equivalent school years between second and sixth graders. We would 
suggest that Rock Point students, having learned to read in a more phonemic 
orthography (Navajo) and having learned to read English at first as if it had 
a phonemic orthography, are better able to handle the apparent lack of fit of 
a more morphophonemic orthography (English). 

Arithmetic Achievement 

Chart 4 (see page 32) depicts the compari&on of total arithmetic achievement 
on SAT. At the second and third grade levels, the bilingual students scored 
lower than the EFL-only students. At the fourth grade, the bilingual stu- 
dents surpassed the achievement of the EFL-only students. The difference at 
this level was nine months, which was significant on the T-test analysis. At 
the fifth grade level the difference in groups was 1.2 years; again this differ- 
ence was significant. No comparison is shown for the sixth grado level be- 
cause only six students were enrolled at that level at Rock Point in 1975. 
MAT test results in 1976 and 1977 show that Rock Point students scored as 
high as, or higher than, Navajo Area mean scores from fifth grade on in 
general arithmetic achievement. 

In general, Navajo students tend to score higj\est on the Arithmetic Compu- 
tation subtest, which is less language-bound and can be mastered through 
rote learning. Arithmetic Application is the subtest on which Navajo students 
tend to score lowest and which usually involves language and problem solving 
strategies. Table 3 displays within- group comparisons of student achievement 
on Arithmetic Computation and Arithmetic Application subtests. The scores of 
the EFL-only students followed the general pattern of Navajo student achieve- 
ment. The mean scores in computation were approximately four to five months 
higher than the mean scores in application at the third and fourth grade 
levels. By the fifth and sixth grade levels the differences in the scores for 
computation and application were 1.2 and 1.0 years, respectively. Computa- 
tion was the arithmetic subtest on which these students consistently scored 
the highest at each grade level. 

The pattern of student achievement in the bilingual school was different. 
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Student mean scores at the third and fourth grade levels showed that mean 
scores for computation were six to seven months higher than the mean scores 
for application, but at the fifth and sixth grade levels, the trend was re- 
versed: mean scores in application were higher. By fifth grade. Arithmetic 
Application became the arithmetic subtest on which the students at Rock 
Point scored highest. 

Table 3. A Comparison of Area Sample (EFL Direct Method) Student Mean 
Scores, 1975. on the Computation and the Application Subtests, 
Stanford Achievement Test. A Comparison of Rock Point (Bi- 
lingual) Student Mean Scores, Three-Year Accumulation 1975-77, 
on the Computation and the Application Subtests, Stanford 
Achievement Test. 



Grade 



CONTROL SCHOOLS 
Mean Scores 



ROCK POINT 
Mean Scores 



Computation 



Application 



Computation 



Application 



3 
4 
5 
6 



2.94 
3.22 
4.40 
4.96 



2.30 
2.81 
3.42 
3.08 



2.87 
3.70 
4.8(> 
6.30 



2.06 
3.04 
5.12 
6.85 



EFL Proficiency 

The results of the TOPESL testing appear in Charts 5 and 6 (see page 33). 
The Rock Point results for 1975 and 1976 have been avera^'ed and compared 
to both the Navajo Area and the Chinle Agency^ 1974 resulttj. 

The English Structure subtest results (Chart 5) showed that Rock Point 
students at the fourth grade level scored higher than Agency and Area fifth 
grade students; Rock Point fifth grade students scored higher than Agency 
and Area sixth grade students. At the sixth grade level. Rock Point students 
scored over 90 percent and were within 10 percentage points of native English 
speakers. The results on the Listening Comprehension subtest (Chart 6) were 
similar. Rock Point fourth graders scored near the Navajo Area mean per- 
centage score for the sixth grade, and they did score as high as the Agency 
sixth graders. Again, the Rock Point sixth grade students scored within 
10 percentage points of native speakers. 

The TOPESL test was designed so that native speakers at a comparable age 
or grade scored 100 percent. Consequently, the top end of the test is very 
difficult to obtain, i.e. the closer a student scores to 100 percent, the more 
difficult any additional gain becomes. A detailed display and description of 
the data appear in the appendices. All T-test comparisons and levels of sig- 
nificance will be found there. 

Summary of Basic Data 

The bilingual grand mean scores for Total Reading (SAT), although lower 
at the second grade, were higher than the EFL-only mean scores for all 
grades three through six. The same pattern characterized mean scores on 
both the Word Study Skills and the Reading Comprehension subtests. Despite 
not having begun reading in English until mid-second grade, the bilingual 
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students did better on tests of reading in English than did EFL-only students 
who had begun reading in English as much as a year- and- a-half earlier. The 
EFL-only means for the Word Study Skills subtest show Uttle "progress" from 
grade two through six. The bilingual means, however, show more than usual 
progress; bilingual sixth graders averaged within two months of the national 
average. 

The bilingual grand mean scores for Total Arithmetic, although lower at the 
second and third grades, were higlier than the EFL-only mean scores for 
grades four and five. The bilingual students, who had studied arithmetic in 
Navajo and English through the second grade, did better on tests of arith- 
metic m or through English at the higher grades than did EFL-only students 
who had studied arithmetic in English only since entering school. Because of 
Rock Point's insistence on mastery of criterion-referenced tests, the bilingual 
students had moved through elementary arithmetic materials more slowly, but 
more thoroughly, than had most Navajo Area students, usually not completing 
third grade" materials until the fifth or even the sixth grade. Under these 
circumstances, the bilingual scores are somewhat more impressive than thev 
seem at first. ^ 

The EFL-only means for the Arithmetic Computation and Arithmetic Applica- 
tion subtests fell in the usual Navajo Area pattern with application means 
tending to faU progressively further behind computation means at each higher 
grade. The bilingual means preserted a different pattern: application means 
tended to more closely approximate computation means at each higher grade 
until, at the fifth grade, the application means actually exceded the compu- 
tation means. The bilingual students not only did better on the less English- 
language-bound Arithmetic Computation subtest, but they also did consider- 
ably better on the more English-language-bound Arithmetic Application sub- 
test. 

The bilingual grand mean scores for the English Structure and the listen- 
ing Comprehension subtests of the TOPESL were markedly higher than those 
of the EFL-only mean scores at all grades tested. Thus the bilingual stu- 
dents, who had spent considerably less time in instruction through English, 
still did better on tests of English as a Foreign Language ability than did 
Navajo Area students in good English-only programs. 

SUPPORTIVE DATA 



The following data support the basic data just presented, and these displays 
are intended to counter some of the more obviouH objections that might be 
raised. The data are a set of mean scores, with no statistical analysis pro- 
vided; four sets are presented: 

(1) A comparison of the Navajo Area sample mean scores and the entire 
Navajo Area mean scores for each grade level two through six is displayed. 
This comparison shows the relation of the sample group mean scores to that 
of Navajo Area students as a whole. 

(2) A comparison of Rock Point achievement and each of the sample schools 
at grade levels two through six is presented. This display shows how Rock 
Point compared with each school, how the sample schools compared with each 
other, and the range in the sample group mean scores. 

(3) A comparison of fourth grade student achievement in 1975 demonstrates 
the difference in achievement of students who had continuous bilingual in- 
struction and those who had interrupted bilingual instruction. 

(4) A comparison of Rock Point student achievement in 1970 and in 1975-77 
demonstrates the difference in achievement before and after Navajo language 
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instruction was added. The primary differences in the educational programs of 
these two groups of students were the extent and continuity of bilingual in- 
struction. 

Navajo Area Sample Schools—Navajo Area Schools 

The authors, with the assistance of the Navajo Area Education Office, se- 
lected a group of Navajo Area schools which had well-established EFL direct 
method programs. These programs, generally, were implemented at the pri- 
mary level. It is our opinion that the sample group represCTited the better, 
if not the best, Navajo Area schools. In order to substantiate this claim, 
data were requested from the Area Education Office that would allow a com- 
parison of the sample means and the Navajo Area means. Area Education was 
very cooperative, but they could only provide the data they themselves had 
available. 

During school year 1974-75 Navajo Area did not conduct an Area- wide stand- 
ardized achievement testing program; therefore, it was not possible to make 
comparisons for that year. Dimng school year 1975-76 Navajo Area reintro- 
duced Area-wide testing but decided to use the Metropolitan Achievement Test 
(MAT) rather than the Stanford Achievement Test (SAT) which had been used 
until 1972. Therefore, any comparison of the sample group and Navajo Area 
has to be made with MAT data and at least one or two years later than the 
basic data used in this study. We beUeve that there were no dramatic changes 
in these years, that the Area sample schools remained among the best of the 
Area schools. 

The Navajo Area Special Projects office provided Area-wide mean scores of 
MAT tests administered in the fall of 1976; however, they were able to locate 
only 1975 data for individual schools and this for only three of the five Area 
sample schools. (The Area sample of five schools were the schools tested in 
• 1975 with the Stanford Achievement Test.) The school the authors considered 
to have the best primary program was one of the two for which no scores were 
available. Consequentiy, Table 4 is a comparison of the 1975 average mean 
scores of three of the five sample schools with the 1976 Navajo Area mean 
scores . 



Table H. A Comparison of Navajo Area (as a Whole) Student Mean Scores 1976 
with the Area Sample Student Mean Scores 1975 on the Total Reading 
and Total Arithmetic Components, Metropolitan Achievement Test. 



READING ARITHMETIC 



Grade Level 



Navajo Area 


Sample 


Navajo Area 


Sample 


1.5 


2.0 


1.4 


1.7 


2.1 


2.3 


2.2 


2.5 


2.4 


2.5 


3.0 


2.9 


2.7 


2.7 


3.4 


3.4 


3.5 


3.6 


4.2 


4.3 



Table 4 shows that the Area sample schools scored as high as, or higher than, 
the Navajo Area mean score at every grade level, except one. At the fourth 
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grade level, the Navajo Area mean score in total arithmetic was one month 
higher than that of the sample schools. The greatest differences were at the 
second and third grade levels, where sample group scores were from two to 
five months higher in reading and arithmetic. 

The sUght superiority of the sample schools, more marked in the lower 
pades, seems to support the assumption that the sample group represents the 
better, if not the best, Navajo Area schools. While the data here are scant, 
the relative "failure" of the Area sample to maintain this advantage in the 
upper-elementary grades should be noted. This may be due, in part, tn the 
relatively recent implementation of intensive EFL programs , and EFL-trained 
students may not have reached the fourth grade. It is more Ukely due to the 
scope of the EFL programs and materials: Area teachers tend to see EFL as a 
primary grade program. 

Rock Point— Navajo Area Sample Schools 

Charts 7 through 11 (see pages 34-36) display comparisons of Rock Point 
student achievement and the student achievement of each of the schools in the 
Area sample. Grade level mean scores for SAT Total Reading are compared at 
each grade level from second through sixth grade. The Rock Point mean 
scores are grand mean scores for 1975, 1976, and 1977. These grand mean 
scores are compared to the 1975 mean scores of each of the Area sample 
schools. The one exception is at the fourth grade level. The sample schools' 
mean scores are composed of an average of the 1975 actual student achievement 
scores and 1976 and 1977 computer-created scores. The computer-created 
scores were used in 1976 and 1977 as the standard of comparison with which 
the Rock Point student achievement was compared. (See Appendix B for a 
more detailed explanation.) The national norms for each grade level are also 
presented. This allows the reader to compare all the mean scores to national 
norms . 

Chart 7 shows that at the second grade level three of the sample schools' 
means were higher in Total Reading than were Rock Point's mean scores. One 
school's mean score was lower. All schools' mean scores were below the 
appropriate national norms. Chart 8 displays a comparison of third grade 
achievement in Total Reading. Rock Point mean scores were as high as or 
higher than those of aU sample schools but one, which had a mean three 
months higher than Rock Point's. Chart 9 exhibits a comparison of Total 
Reading achievement at the fourth grade level. Rock Pdnt students' mean 
score was higher than the mean scores of all of the sample schools. The 
range in difference was from one to seven months. 

Charts 10 and 11 display comparisons of Total Reading achievement at the 
fifth and sixth grade levels. The Rock Point mean score was higher than that 
of all the Area sample schools at both levels. The range at the fifth grade 
level was from 1.4 to 2.1 grade-level-eqmvalent years. The range at the 
sixth grade level waa 1.4 to 2.6 grade-level-equivalent years. At the fifth 
grade level, the Rock Point mean score was five months below the national 
norm. At the sixth grade level. Rock Point was within three months of the 
national norm. 

The data presented in Charts 7 through 11 demonstrate that there was a 
wide range in the sample schools' achievement, particularly at the fifth and 
sixth grade levels. The data also show that at the fifth and sixth grade 
levels the Rock Point mean scores were higher, by at least 1.4 grade-leve!- 
eqirivalent years, than any of the sample schools' mean scores. The combi- 
nation of scores from different schools in the Area sample has not been used 
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to hide schools with scores better than Rock Point's in the upper elementary 
grades • 

Rock Point Continuous Bilingual Instruction — Rock Point 
Interrupted Bilingual Instruction 

In 1975, the Rock Point fourth grade was composed of students who had re- 
ceived continuous bilingual instruction and of students whose bilingual instruc- 
tion had been interrupted. The former group had begun school receiving 
initial literacy, arithmetic, and content subjects instruction in Navajo. They 
continued to receive bilingual instruction throughout their elementary school- 
ing. The latter group had also entered school in a bilingual classroom. They 
received reading readiness and content subject instruction in Navajo, but the 
following year they entered into a monolingual, EFL direct method curriculum. 
From the third grade level on, these students received science, social studies, 
and upper-grade Navajo literacy instruction in Navajo. These children had 
entered school before Rock Point received its first Title VII grant; previously. 
Rock Point (receiving only Title I funds) had operated only a limited first year 
bilingual program. 

Both groups were tested in May, 1975 on the 1973 edition of the SAT Total 
Reading subtests, with 20 students in each testing group. Table 5 displays 
the results of the comparison. Students who had received continuous bilingual 
instruction scored approximately eight months higher than their classmates who 
had not. In some respects this comparison may provide the most meaningful 
information for evaluating the effects of bilingual education since most aspects 
of the instructional situation were the same. The major differences between 
the two groups were the extent and continuity of Navajo language instruction 
in a coordinate bilingual education program. (It should be noted, however, 
that the students whose bilingual education had been interrupted seemed to 
be older, academically slower children.) Although the preceding data must be 
used with caution, the test results seem to indicate that continuous bilingual 
instruction may have provided a more effective learning environment. 

Table 5. A Comparison of the Mean Scores of Rock Point Fourth Grade Stu- 
dents Who Had Continuous Bilingual Instruction with the Mean 
Scores of Rock Point Fourth Grade Students Who Had Interrupted 
Bilingual Instruction on the Total Reading Component, SAT, in 
1975. 





TYPE OF 


INSTRUCTION 




Continuous 


Interrupted 


Group 


Bilingual 


Bilingual 


National Norm 


4.8 


4.8 


Rock Point Fourth Grade 


4.2 


3.4 


Relationship to the National Norm 


.6 below 


1.4 below 



Rock Point Bilingual (1975-1977)— Rock Point EFL-Only (1970) 



Chart 12 (see page 36) shows a comparison of Rock Point student achieve- 
ment in 1970 with the grand mean achievement of Rock Point students for 
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1975 1976 and 1977. The 1970 scores represent the achievement of students 
T?r.f "J^^^^ ^^^^"^^ instructional program had been an inten- 

sive EFL-only program. Only the second grade students could have partici- 
pated in bmngual instruction. In 1970. Navajo Area tested only the second, 
tourth. and sixth grade levels, using the 1964 edition of the SAT. (Rock 
Foint was. at that time. stiU a Bureau- operated school.) The grade-level- 
equivalent mean scores for each of the grades tested have been converted to 
grade-level-eqiuvalent scores for the 1973 edition of the SAT using a conver- 
sion table provided by the publishers (Stanford Research Report. 1973:1-14) 
Since the two editions of the SAT differ significantly, only reading compre- 
hension subtests are compared. The 1964 edition Paragraph Meaning subtest 
means are compared to the 1973 edition Reading Comprehension subtest means, 
ine Navajo Area mean scores (norms) which had been established for the 1964 
SAT edition are also presented in Chart 12; these have been converted to 1973 
grade-level-equivalents to allow comparison. 

Chart 12 shows that the EFL-only students (1970) scored approximately .8 
years higher at the fourth grade level than the bilingual students (1975-1977). 
WW ^af'^ti®/®^' bilingual students (1975-1977) were .7 years 

higher than were the EFL-only students (1970). The sixth grade comparison 
IS most significant because Rock Point, since the mid-1960s, had consistently . 
scored higher than the Navajo Area norms at this level. The seven-month in- 
crease placed Rock Point students within four months of the national norm 
Because the norming group used to develop the conversion table was very 
small--less than 200 students per grade level- -and because the publishers indi- 
cate that there are a number of differences between the two tests (Stanford 
Research Reports. 1973). this comparison must be used with caution. 

Corroboratory information can be obtained by examining the differences in 
mean grade-level-equivalent scores between the achievement of Rock Point stu- 
dents and Area student achievement on the same edition of the SAT. Table 6 

^ ^ display of such mean score difference. Comparison A shows 
the difference in mean scores at the sixth grade level between the Navajo Area 
norm and Rock Point in 1970. This is a comparison of the achievement of stu- 
dents in an intense EFL-only program (Rock Point 1970) with students in 
mixed EFL-only and non-EFL programs (Navajo Area). The difference in the 
?n^^ l^r®^ seven months. The test instrument for both groups was the 
1964 edition of the SAT. 

Comparison B displays the mean score difference between the three-year 
meS J'fL^ -""T (1975-1977) for the sixth grade and the sixth ^ade 
mean of the Navajo Area sample (1975). the data used in this study. All stu- 
dents were tested on the 1973 edition of the SAT. The difference in mean 
ZZZJ"-^^ ^'1^^"^^- .^"hough the Rock Point student achievement was 
Zttftl ^^"'P^^s^^s. the difference in comparison B is nine months 

t^ bHn ^^oVl °t"'P-r^?i- • introduction of biUngual instruction seems 
to be an important, if not the important, factor in the increased difference in 

1^17""^ "J^^^'f" "^^^^ Navajo Area students. T^e com- 

parisons displayed in Chart 12 and Table 6 have an inherent weakness. beSig 
based on scores from two different editions of the SAT. It would appear 
however that the reading in English achievement of Rock Point students has 
increased since the introduction of bilingual instruction. 

in^nW.rfV^'^Fr^^^^^^ "°*f^- 1970 Rock Point results 

^*if °^ ^ degreed, largely non-Navajo staff; no NLT had a de- 

gree and there were no Navajo ELTs. The 1975-1977 results involved the 
efforts of a largely (half to three-quarters) nondegreed staff, of whom half 



24 



Rock Point 



Table 6. A Comparison of Mean Score Difference at Sixth Grade: (A) A 
Comparison of the Area (EFL Direct Method or No Method) Sixth 
Grade Student Mean Score 1970 with the Rock Point (EFL Direct 
Method) Sixth Grade Student Mean Score on the Paragraph Meaning 
Subtest, Stanford Achievement Test (1964 Edition). (B) A Com- 
parison of the Area Sample (EFL Direct Method) Sixth Grade Student 
Mean Score 1975 with the Rock Point (Bilingual) Sixth Grade Student 
Mean Score on the Reading Comprehension Subtest, Stanford Achieve- 
ment Test (1973 Edition). 



COMPARISON A COMPARISON B 

SAT PARAGRAPH MEANING SAT READING COMPREHENSION 

(1970) (1975-1976-1977) 



Area Rock Area Rock 

Norm Point Difference Sample Point Difference 

4.1 4.8 .7 4.5 6.1 1.6 



to three-quarters were Navajo; by 1977, half of the ELTs were Navajo. The 
teaching staff in 1975-1977 consisted of a majority of teachers for whom Eng- 
lish was their second lan^age and who were working toward or had recently 
obtained a degree. They were formally less well prepared than were Rock 
Point teachers in 1970 or Navajo Area teachers in 1975-1977, yet they seem to 
have achieved better resxilts as indicated by student performance on standard- 
ized achievement tests. 

We do not have data to substantiate our distinct impression that, probably 
due to continued drift of the more acculturated (English speaking) students 
from Bureau to public schools, Navajo Area means have been falling in recent 
years. If this should be the case, the apparent rise in Rock Point scores for 
the sixth grade is even more impressive than it would at first seem. While 
none of the comparisons in this section is in itself conclusive, taken together 
they indicate that a change in the languages of instruction has accompanied, 
and probably caused, an improvement in already high (for Navajo Area) test 
mean scores. 

PATTERNING OF DATA 

This section presents several analyses of patterning perceived in the data 
presented in the preceding sections. The data are derived almost entirely 
from the mean scores presented as basic data; no additional statistical analyses 
were performed. 

(1) Data is presented to show that Rock Point grand means tend to diverge 
further from Navajo Area means at each higher grade level. 

(2) Data is presented to show that while Navajo Area means tend to diverge 
further from national norms at each higher grade level. Rock Point grand 
means tend to converge, after the fourth grade, toward national norms at 
each higher grade. 

(3) Data is presented to show that, assuming the one-time data available 
would be comparable to longitudinal data not available, the Rock Point stu- 
dents tend to be making up to twice the amount of progress between grade 
levels as are Navajo Area sample students. 

3i 
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(4) Data is presented to show that, given the same assumptions as above, 
Area sample students are progressing at about half the national average rate 
of progress, while Rock Point students are progressing at about the national 
average rate and may be exceeding that rate at the fifth and sixth grades. 

Divergence 

The Rock Point grand means tend to diverge further from the Navajo Area 
means at each higher grade. The following data are drawn from Charts 1 
and 4. 



Table 7. 



Total Reading 


2 


3 


4 


5 


6 


Rock Point 


1.94 


2.39 


3.13 


5.05 


6.20 


Area Sample 


2.16 


2.29 


2.67 


3.41 


4.16 


Difference * 


-.22 


+.10 


+ .46 


+1.64 


+2.04 


Total Arithmetic 


2 


3 


4 


5 


6 


Rock Point 


2.11 


2.37 


3.29 


5.02 




Area Sample 


2.44 


2.49 


2.35 


3.84 




Difference 


-.33 


-.12 


+ .84 


+1.18 





Noting this. Rock Point is inclined to ascribe these differences to the ef- 
forts of initial and continuing instruction in Navajo and to say that these 
effects are cumulative. A devil's advocate might point out that the really 
significant differences occur at just those grades where the amount of time 
for instruction through Navajo is reduced to less than half, i.e. instruction 
through Navajo might be holding the students back. Data cited earlier showed 
that Rock Point fourth grade students who had received uninterrupted bi- 
lingual instruction had done better than those who had received interrupted 
bilingual instruction and that Rock Point sixth grade students who had re- 
ceived bilingual instruction had done better than had Rock Point sixth grade 
students who had received EFL-only instruction only five, six, or seven years 
earlier. This strongly suggests that the use of Navajo as a language of in- 
struction caused, at least in part, higher academic achievement as measured 
on EngUsh language standardized achievement tests. 

Convergence 

Another aspect of the same patterning is the degree to which mean scores 
approximate national norms. On both the Total Reading and the Total Arith- 
metic subtests, Navajo Area sample means tend to diverge further from the 
national norms at each higher grade level. ^ Rock Point grand means, how- 

ever,' tend to diverge until the fourth "grade level; thereafter, they "tend to 

converge towards national norms. The data again are drawn from Charts 1 
and 4. 
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Table 8. 



Total Reading 


2 


3 


4 


5 


6 


National Norms 


2.5 


3.5 


4.5 


5.5 


6.5 


■TLX t;cl O cinipi6 


9 1ft 
Z. lO 




2. 67 


3.41 


4.16 


1^ X 1 1 Fenc es 




-1. 21 


-1. 83 


-2.09 


-2.34 


National Norms 


2.5 


3.5 


4.5 


5.5 


6.5 


JlvVli^iV irUXZlL 


1 QA 


o on 
2. 39 


3. 13 


5. 05 


6.20 




— Kft 
. 00 


-1. 11 


-1. 37 


-.45 


-.30 


Total Arithmetic 


2 


3 


4 


5 


6 


National Norms 


2.5 


3.5 


4.5 


5.5 


6.5 


Area Sample 


2.44 


2.49 


2.35 


3.84 




Differences 


-.06 


-1.01 


-2.15 


-1.66 




National Norms 


2.5 


3.5 


4.5 


5.5 


6.5 


Rock Point 


2.11 


2.37 


3.29 


5.02 




Differences 


-.39 


-1.13 


-1.21 


-.48 





Progress 

Longitudinal data are not available for the Navajo Area sample schools. If 
one assumes, however, that most students remain in the same school from 
kindergarten through sixth grade and are promoted to the next grade each 
year, and that mean scores at each grade have tended to be more or less con- 
stant for the last five years or so, then one can treat the one-time data given 
earlier as multi-year data. (E.g. if last year's third graders are this year's 
fourth graders, and this year's third and fourth grade means are each com- 
parable to last year's means, then the difference between this year's third 
and fourth grade means is roughly the same as the amount of progress made 
by this year's fourth graders since last year.) The data in Table 9 (see 
page 27) are drawn from Charts 1 and 4. 

There seems to be for both groups (with the exception of the anomalous 
fourth grade Area sample arithmetic means shown in Table 9) an acceleration 
of progress from the second through the sixth grade; this seems to be more 
marked between the fourth and fifth grade for both Rock Point students and 
for Area sample. (As noted earlier (page 21), we feel the fourth grade scores 
may be suspect.) The progress for Rock Point students is markedly higher— 
at least double that of Area sample students for all comparisons except fifth 
grade arithmetic. 

Initial efforts to develop longitudinal progress data for students at Rock 
Point between school years 1977 and 1978 have given us indications of some of 
the inadequacies of such growth comparisons. StiU, such comparisons are 
indicative of progress patterns. Until or unless we are able to develop longi- 
tudinal data for a number of schools, controlling those variables noted earlier, 
such comparisons will be only that: indicative. 

Rate of Progress 

A "rate of progress" is a hypothetical construct that may be of some utility 
in comparing programs, but it is dependent upon the assumptions noted 
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Table 9. 



Total Reading 


3 


4 


5 


6 


Area Grade N 


2.29 


2.67 


3.41 


4.16 


Area Grade N-1 


2.16 


2.29 


2.67 


3.41 


Differences 


+ .13 


+.38 


+ .54 


+.75 


RP Grade N 


2.39 


3.13 


5.05 


6.20 


RP Grade N-1 


1.94 


2.39 


3.13 


4.16 


Differences 


+.45 


+ .74 


+1.92 


+2.04 


Total Arithmetic 


Area Grade N 


2.49 


2.35 


3.84 




Area Grade N-1 


2.44 


2.49 


2.35 


3.84 


Differences 


+.65 


-.14 


+1.49 


RP Grade N 


2.37 


3.29 


5.02 




RP Grade N-1 


2.11 


2.37 


3.29 


5.02 


Differences 


+ .26 


+.88 


+1.73 





previously. An assumption implicit in the use of national noi'ms for standard- 
ized achievement tests is that the "average" student makes 1.0 grade- 
equivalent school years (or 10 grade-equivalent school months) progress dur- 
ing 10 months in school. The national average rate of progress — 10 months 
progress in 10 months time—would be 100 percent. Progress at other schools 
may be compared to this by taking the difference between the highest grade's 
and the lowest grade's means and dividing this by the number of school months 
between the two grades (as if this were longitudinal data). The data also 
require the assumptions outlined in the previous section. 

Table 10. 











MONTHS 




Reading 


6th 


2nd 


Difference 


In School 


Rate 


Area Sample 


4.16 


2.16 


20.0 mos 


40 mos 


50% 


Rock Point 


6.20 


1.94 


42. 6 mos 


40 mos 


107% 










MONTHS 




Arithmetic 


5th 


2nd 


Difference 


In School 


Rate 


Area Sample 


3.84 


2.44 


14.0 mos 


30 mos 


47% 


Rock Point 


5.02 


2.11 


29. 1 mos 


30 mos 


97% 



The data, drawn from Charts 1 and 4, suggest that the Area sample stu- 
dents, who are doing somewhat better than Area- as- a- whole students, are 
progressing at about half the national average rate; Rock Point students, well 
behind national norms at the second grade and still somewhat behind the 
national norms at the fifth or sixth grade, are progressing at rates slightly 
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above or below the national average. Even this is misleading. Progress, as 
inferred from Charts 1 and 4, is not uniform; it seems to accelerate between 
the fourth and fifth grades. The rate of progress, if computed for Total 
Reading at Rock Point between the fourth and sixth grades, would be 153 per- 
cent. 

It is not known if rates of progress in excess of 100 percent can be main- 
tained in junior high and beyond. If we see such mean scores as relatively 
indicative of current academic ability and of future academic potential, and if 
we accept the validity of the Bereiter-Engelmann dilemma,** then we must find 
ways to try to see that such rates of progress do continue. 

CONCLUSIONS 

We feel we can draw the following conclusions from the data presented in 
preceding sections. 

• Navajo students who had initially been taught to read in Navajo seem, by 
the third grade, to read better in EngUsh than Navajo students who had been 
taught to read in English only and had been reading in English for loneer 
lengths of time. b & s 

• Navajo students had the most difficulty with the Word Study Skills read- 
ing subtest. Interestingly enough, the difference in favor of the students 
who had initially learned to read in Navajo over the students who had learned 
to read only in English was even more marked for Word Study Skills than for 
Reading Comprehension. 

• Navajo students who had initially been taught arithmetic in Navajo seem, 
by the fourth grade, to do better in arithmetic than students who had been 
taught arithmetic only in English—despite the slower pace of arithmetic in- 
struction in the bilingual program. 

• Navajo students who had been taught in both Navajo and English seem to 
do better in English (as a foreign or second language) than Navajo students 
who had been taught only in English. This is despite the fact that the bi- 
lingual students had been exposed to less instruction through English per day 
and had had cumulatively less exposure to instruction through English during 
their school careers. 

• It would appear, contrary to the findings of other studies, that ability in 
English (as a foreign or second language) is not necessarily a simple function 
of the length or amount of in-school exposure to English. 

• Similar patterns in the results of reading, arithmetic, and EFL tests 
strongly suggest that the results of initial instruction in Navajo may be cumu- 
lative: at each grade above the second or third, the bilingual students' 
scores diverge further from those of the EFL direct method students and con- 
verge closer toward national norms. 

• Although there must be instances — perhaps temporary — of negative transfer 
from Navajo learning to English learning, these may be more than offset by 
positive transfer from academic learning through Navajo to academic learning 
through English. 

• In short, under the circumstances given, a good bilingual program showed 
demonstrably better results than did good EFL direct method programs in 
relatively comparable schools. 

The Cumulative Effect 

One cannot prove that the incorporation of Navajo language instruction into 
the Rock Point program caused these results. We must admit that the use of 
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the Navajo language as a means of academic instruction is part of a mix that 
includes, among other things, increased community control, increased parental 
involvement, increased number of Navajo and community teachers, intensive 
E¥L activities, on-gomg evaluation, and intensive and extensive NLT and ELT 
training. 

We can only say that whatever is happening at Rock Point, the effects seem 
to be cumulative. An evaluation of the Rock Point program after the first five 
years of operation might have shown that Rock Point third and fourth graders 
were averaging littie better than Navajo Area third and fourth graders It 
was oiay when those Rock Point students who as kindergarteners had learned 
to read in Nava]o began to reach the fifth and sixth grade that dramatic differ- 

^^^S we suggest, has important impli- 

cations for the funding and evaluation of Indian bilingual programs. 
In Bilingual Education, Joshua Fishman writes: 

* °^ whole, bilingual education is too frail a device, in and of 
Itself, to sigraficantiy alter the learning experiences of the minority- 
raother-tongue-poor in general or their majority-language-learning- 
success in particular. It is of course true that foisting a language 
other than their own upon such children is equivalent to imposing an 
extra burden upon those least capable of carrying it. However, pre- 
cisely because there are so many other pervasive reasons why such 
cinldren achieve poorly the goals of majority- oriented and -dominated 
schools (and societies) , removing this extra burden above—and leav- 
ing all else as it was- -does aot usually do the trick, particularly when 
the teachers, curricula, and materials for bilingual education are as 
nonoptimal as they currently usually are. (1976) 

The preceding is not an indictment of bilingual education per se but an indict- 
ment of bihngual education as "compensatory" education. At Rock Point, not 
just the language of instruction has been changed; teachers, materials, and 
curricula have all been changed. 

In a number of papers, Bernard Spolsky has pointed out that in the evalu- 
ation of bilingual education 

educational results are only one set of outcomes among several that are 
relevant. At each state of development, starting from the decision to 
establish a bilingual program, there are economic, political, sociological, 
psychological, religious and cultural factors and effects that need to be 
taken into account. What happens in the classroom is important, but it 
IS also necessary to study the school in relation to the community it 
serves. (1974) 

Such an analysis of the Rock Point experience—as is suggested by Spolsky— 
would require quite another monograph; suffice it to say that bilingual edu- 
cation at Rock Point has involved something more than a change in the lan- 
page(s) of instruction. This change has been accompanied by changes in 
teaching personnel, materials, and methods and in school organization and 
governance; there have been complex and interrelated educational, linguistic, 
somal, political, and economic changes in the school and in the community. 

The mUlemum has not arrived. After 12 years, bilingual education at Rock 
Foint and among the Navajo is stiU a precarious venture, beset by all the 
personal, institutional, and financial problems of new programs elsewhere. 
But the program has survived and has had some success. The importance of 
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the Rock Point experience is twofold. (1) At a time when the first flush of 
enthusiasm is over, and the academic efficacy of bilingual education programs 
is being seriously questioned. Rock Point^s program emerges as one of the few 
American programs with relatively hard data, demonstrating over time the aca- 
demic "success" that did not show in the first few years of the program. 
(2) The Rock Point experience may be understood to be saying that bilingual 
education programs for economically disadvantaged groups, if they are to be 
"successful," must involve much more than a mere change in the language(s) 
of instruction. 

NOTES 

1. A common way of expressing achievement test scores is in terms of 
grade-equivalents. A school year is thought of as having 10 months. The 
national average for students in the sixth month of the third grade becomes 
the 3.6 norm, etc. The terms "years" and "months" in this section refer to 
grade- equivalent years or months. 

2. Chinle Agency is the interior Agency of the Area, farthest from 
English-speaking population centers. 

3. It is this pattern that some of the more emotional critics of Indian edu- 
cation are alluding to when they say that test scores for Indian students go 
down each year they are in school. The situation described is bad enough; 
one need not claim or imply that there is an absolute decline in test scores 
at each higher grade. 

4. Bereiter and Englemann, in their various writings, have described the 
dilemma that minority and disadvantaged children face when entering school. 
These children begin school behind middle-class children — that is, they are 
often linguistically less competent in English than middle-class children and 
they have had fewer middle-class experiences on which school curricula are 
based. Consequently, these children must learn more and learn it faster to 
be caught up with middle-class children. This concept is commonly referred 
to as the Bereiter- Englemann dilemma. If we assume that most Navajo stu- 
dents start, in some nonmoral sense, "behind" middle-class Anglo students in 
academic achievement in English, and that it is desirable and necessary that 
they "catch up" with middle-class Anglo students at some point in their aca- 
demic careers, then it will be necessary for Navajo students to go further 
and /or faster to catch up. 
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Chart 1. 



A Comparison of Rock Point Student Achievement Mean Scores, 
Three-Year Accumulation, 1975-77, with the EFL Direct Method 
Student Achievement Mean Scores in Total Reading. 
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Chart 2. 



A Comparison of Rock Point Student Achievement Mean Scores, 
Three-Year Accumulation, 1975-77, with the EFL Direct ^^ethod 
Student Achievement Mean Scores, 1975, in Word Knowledge Skills. 
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Chart 3. A Comparison of Rock Point Student Achievement Mean Scores, 
Three-Year Accumulation, 1975-77, with the EFL Direct Method 
Student Achievement Mean Scores in Reading Comprehension. 
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Chart 4. >1 Comparison of Rock Point Student Achievement Mean Scores 
with the EFL Direct Method Student Achievement in Total 
Reading, 1975. 



J Grade 2 Grade 3 Grade 4 Grade 5 




Control School 



^ Rock Point 



The Study 



Chart 5. A Comparison of Group Mean Percentage Scores of Rock Point Student 
Achievement, 1975-76 Average, with Chinle Agency Student Achievement 
and with Navajo Area Student Achievement, 1974, on the TOPESL 
Subtest English Structure. 




Chart 6. A Comparison of Group Mean Percentage Scores of Rock Point Student 
Achievement, 1975-76 Average, with Chinle Agency Student 
Achievement and with Navajo Area Student Achievement, 1974, on 
the TOPESL Subtest Listening Comprehension. 
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Chart 7. A Comparison of the ''National Average " Student Mean Score; Rock Point (Bilingual) 
Student Mean Score, Three-Year Accumulation, 1975-77; and the Student Mean Scores 
for Four of the Five Area Sample Schools (EFL Direct Method), 1975, on the Total 
Reading Component, Standard Achievement Test, Second Grade Level 

3.0 




Nat'l Rock Point School 1 School2 Schools School4 



♦Note: No scores were reported for School 5 at the second grade level. 



Chart 8. A Comparison of the ''National Average'' Student Mean Score; Rock Point (Bilingual) 
Student Mean Score, Three-Year Accumulation, 1975-77; and the Student Mean Scores 
of Each of the Five Area Sample Schools (EFL Direct Method), 1975, on the Total 
Reading Component, Standard Achievement Test, Third Grade Level 
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Chart 9. A Comparison of the ''National Average'' Student Mean Score; RockPoint (BiUngual) 
Student Mean Score, Three-Year Accumulation, 1975-77; and the Student Mean Scores 
of Each of the Five Area Sample Schools (BFL Direct Method), 1975, on the Total 
Reading Component, Standard Achievement Test, Fourth Orade Level 
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Chart 10. A Comparison of the ''National Average'' Student Mean Score; Rock Point (Bilingual) 
Student Mean Score, Three-Year Accumulation, 1975-77; and the Student Mean Scores 
of Bach of the Five Area SampleSchools (EFL Direct Method), 1975, on the Total 
Reading Component, Standard Achievement Test, Fifth Orade Level 
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Chart 11. 



A Comparison of the **National Average" Student Mean Score; Eock Point (BiUngual) Student 
Mean Score, Three^Year Accumulation, 1976-77; and the Student Mean Scores of Each of the Five 
Area SampUSchooU (EFL Direct Method), 1976, on the Total Reading Component Standard 
Achievement Test, Sixth Grade Level 
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Chart 12. A Comparison of Navajo Area (EFL Direct Method or NO Method) Student Mean Scores, 1970; 

Rock Point (EFL Direct Method) Student Mean Scores, 1970; and Rock Point (Bilingual) Student 
Mean Scores, Three-Year Accumulation, 1976-77, for the Second, Fourth, and Sixth Grades on the 
Poragraph Meaning (1970) and the Reading Comprehension (1976-77) Subtests, Stanford Achievement 
Test AUMean Scores Converted to 1973-Edition Equivalent 
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RELATIONSHIP TO THE LITERATURE 

The body of literature on bilingual education is growing, and several signifi- 
cant studies have been reported. Some of these have implications for or re- 
late to the Rock Point Study, These studies will be described in the following 
sections: (1) literature that showed no difference in either monolingual in- 
struction or bilingual instruction; (2) literature . that supports monolingual 
instruction; (3) literatxire that supports bilingual instruction; and (4) litera- 
ture with implications for bilingual education. In each section, the literature 
directly involving Navajo children will be presented first. 

Literature That Showed No Difference In Either Method 

Several studies have been conducted with Navajo children; however, only 
the Rock Point Study compares Navajo children in EFL direct programs and 
Navajo children in a bilin^al program where initial reading was taught in 
Navajo. Therefore, all of the studies described in this section are with non- 
Navajo children. 

Horn conducted a reading readiness study with Spanish speaking children; 
the study involved three approaches to reading readiness. Horn divided 28 
first grade classrooms in three groups: the first g^roup used an oral-aural 
English readiness method; the second group used an oral-aural Spanish readi- 
ness approach; the third group did not use an oral- aural approach, but used 
the school district's culture fair materials. The groups were pre- and post- 
tested using the Metropolitan Readiness Test. The post- testing demonstrated 
no significant difference between the groups. Horn concluded that most 
standardized tests are inappropriate instruments for this type of investigation 
(1966) . 

Huzar compared two groups of Puerto Rican children at the second and third 
grade levels. The experimental group had participated in bilingual instruction 
since entering school; the control group had been taught in English only. 
(The terms "experimental group" and "control group" are used extensively 
throughout this section. Experimental group refers to a group of children 
who received some type of bilingual instruction. Control group refers to 
students taught in a monolingual instruction program; in most cases the lan- 
guage was English. ) Huzar found no significant difference in reading with 
all students, but in a comparison of boys only, there was a difference in 
favor of the experimental pfroup (1973). 

Valencia reported on a bilingual program with Mexican-American children in 
Pecos, New Mexico. The experimental and control students had participated 
in the program since entering school. The two groups were tested at the end 
of fourth and fifth grades, using the California Achievement Test. There was 
no significant difference between the groups at either level (1970). 
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Cohen studied the achievement of Mexican- American students in Redwood 
City, CaKfomia and was concerned with several aspects of learning and atti- 
tude development. One aspect dealt with reading. Students, except for one 
experimental group , started reading simultaneously in both English and Span- 
ish; the experimental group learned initial reading in Spanish. Children 
taught xising a bilingual curriculum were compared with children taught using 
the state curriculum- -a monolingual English program. The study was con- 
ducted over a three-year period, and students were tested with the Murphy- 
Durrell Reading Readiness Analysis Test. 

The results of the research found no significant difference in reading 
achievement between the two groups of students. Cohen did find significant 
differences in two related aspects of the study. He found that the children 
in the bilingual curriculum were "significantly more positive toward the Mexi- 
can culture," and that these same students expressed attitudes toward Anglo 
culture which were as positive as those expressed by the students taught us- 
ing the curricvdum recommended by the state. Also, the attendance of chil- 
dren in the bilingual program was much better than that of the students in 
the state program, and the students in the bilingual program expressed a 
more positive attitude toward school than did the control students (1975). 

Two other studies conducted by Skoczylas and Velasquez showed similar re- 
sults. There was no significant difference in general achievement, but both 
studies concluded that children seemed to demonstrate more positive self- 
images when instructed in a bilingual curriculum (1972; 1974). 

Herbert reported on a sample of four projects in the state of Texas, located 
in the cities of Houston, AKce, San Antonio, and Abernathy. In each proj- 
ect, experimental and control groups were established. The experimental 
students were introduced to reading in Spanish and later in the year, to Eng- 
lish reading, while the control students were taught initial reading in English. 
Results at the end of first grade were reported for only three projects. The 
test results in two of the projects indicated a significant difference in favor of 
the control groups. In the other program, there was no difference. Herbert 
examined the relationship between the Spanish reading achievement and the 
English reading achievement of the experimental students. He found that 
those who scored well in Spanish reading also scored well in English reading. 
This may or may not be the result of the transfer effect (1971). 

These studies indicate that there is little difference in achievement at third 
grade and below. Herbert's report showed that the children in the mono- 
lingual English programs scored significantly higher than the children in the 
bilingual program. The Rock Point Study supported these findings; at the 
second grade level, students' achievement at Rock Point generally was below 
that of students in EFL direct method programs. At third grade level. Rock 
Point students' achievement was equal to that of the EFL direct method stu- 
dents' achievement, but only in a few cases were there significant differences. 
One conclusion drawn from the combined results of these studies is that gains 
in achievement in bilingual programs do not begin to appear on standardized 
tests until later- -fifth or sixth grade. Children need more than one or two 
years of bilingual instruction to benefit from such instruction. 

Literature That Supports Monolingual Instruction 

There have been studies of the effects of using Teaching English as a 
Second Language (TESL) techniques with Navajo children. Although none of 
these studies compares TESL techniques with the bilingual method, the studies 
have provided useful information. Willink compared achievement of Navajo 
students who received TESL instruction with those who did not. She found 
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a significant difference in achievement scores in favor of using TESL instruc- 
tion (1968). This study was of particular interest because one of the experi- 
mental schools was Rock Point Community School, which was the focal point of 
this report. Willink collected the data in 1967; none of the students in her 
study had received bilingual instruction.^ 

Shipp investigated the achievement of Navajo second and third graders who 
attended school in the eastern portion of the Navajo reservation. The study 
was a comparison of the reading achievement of children taught using the 
Direct Instructional System for Teaching Arithmetic and Reading (DISTAR) 
with the reading achievement of children taught using non-DISTAR materials 
(1975). The publishers claim that one function of the DISTAR program is to 
provide special remedial work for second language speakers. The DISTAR 
curriculum is designed for a broad popidation and is not designed specifically 
for Navajo children as the CITE and NALAP curricula are (Yungho, 1972), 

Stahl examined the effects of CITE instruction on students' reading achieve- 
ment, comparing children's achievement in CITE programs at the second grade 
level with the achievement of students in non-CITE programs. He compared 
students in 12 paired schools—one school of each pair used CITE in the pri- 
mary grades and the other school of the pair used a non-CITE program. He 
found an overall significant difference in reading achievement of the students 
instructed using the CITE curriculum. In the paired situation, four CITE 
programs are significantly superior. The control school test scores were 
superior to the two experimental schools' test scores in the other two pairs. ^ 

l^^e literature that focuses on the EFL direct method with reference to 
Nav5:jo students is limited, but the exddence indicates that organized TESL 
curricula are more effective than non-TESL currictda. The remainder of this 
subsection describes studies and literature in non-Navajo bilingual situations. 

The Rizal Study was conducted in the Philippines in the early 1960s. The 
study compared children who received vernacular instruction with those who 
received continuous monolingual English instruction. The students taught in 
the vernacular spent the first two years of school in that language, then 
switched to English. The results of the study at the sixth grade level showed 
that the children who had English the longest—beginning initially in English- 
did better than students introduced to school subjects in the vernacular 
(Engle, 1975). 

Pozzi-Escot conducted a study of the bilingual method and EFL direct method 
in Peru. She studied three groups: one group used the bilingual method; 
one group used the EFL direct method; and the control group used the regu- 
lar curriculum. After three years the jgroups were tested in their competency 
in reading Spanish. The group taught using the EFL direct method scored 
the highest. The tests and group compositions were not described, nor were 
statistical data provided (Engle, 1975). 

Probably the strongest support for monolingual instruction is the St. Lam- 
bert Experiment. Lambert and Tucker (1972) and Lambert (1974) reported on 
this unique experiment. Conducted in Canada, the study reflects the English- 
French bilingual situation of that nation. 

Three groups were established. The experimental group was composed of 
English speaking children who entered a French immersion kindergarten pro- 
gram. They remained in a total-immersion monolingual French program until 
second grade, then English language arts were introduced for one hour a day. 
All other subjects were in French, taught by native French speaking teachers. 
The second group, the English controls, received the regular curriculum with 
one hour a day of French as a Second Language (FSL) instruction. The third 
group, the French controls, received the regular French curriculum for French 
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schools in Canada. All children in the study were from middle and upper 
classes. 

The study examined several factors, but two are relevant to this problem. 
First, it compared the English language skills of the experimental students 
and the English control students to see if the experimental group had been 
limited in English development in any way. Second, a comparison with both 
control groups was conducted to determine how the experimental group com- 
pared in French. The results at the end of the fourth grade were impressive. 
The comparisons of English skills on standardized tests showed that the per- 
formance of the experimental group was equal to that of the English control 
group. 

The comparison of French skills is more relevant to this study. The experi- 
mental groups s performance was far superior to that of the English control 
groups who received FSL instruction. They performed nearly as well as the 
control group of native speakers in French competency and scored as well as 
the French control group in all the reading areas on the standardized tests 
(1972 and 1974). 

The Elgin Study conducted by Barik and Swain supports the St. Lambert 
Experiment. The Elgin Study compared students who spent a half day in Eng- 
lish and a half day in French with those students who participated in the St. 
Lambert Experiment. At the end of third grade the Elgin students were 
competent in French at the same level achieved by the St. Lambert students 
at the end of first grade. Barik and Swain provide no socioeconomic infor- 
mation, but it is assumed that the Elgin students were middle class (1974). 

The St. Lambert Experiment's methodology is supported by a similar curricu- 
lum used in the Toronto French School. The program has existed for 13 years. 
A significant feature of this program is that children enter it at three or three- 
and-a-half years of age~a much earlier age than that of children entering most 
traditional programs. The children enter the school as monolingual English 
speakers. The curriculum is conducted entirely in French until the second 
grade; English reading is then introduced at that level. 

Children seem to learn to read well in both English and French, but no in- 
formation is provided as to how well they read French. Some data were pro- 
vided on English reading which indicated that by sixth grade the students 
performed as much as three years above grade level (Giles, 1971). The 
achievement results of both the St. Lambert Experiment and the Toronto 
French School indicate that students were not retarded in their native lan- 
guage by participating in a bilingual program. 

These studies, particularly the Canadian reports, strongly support mono- 
lingual-immersion instruction. The Navajo studies all focus on TESL and none 
compared monolingual TESL instruction with bilingual instruction. The Rock 
Point Study supported the use of well-developed TESL curricula, and one 
component of the Rock Point program was a strong kindergarten through sixth 
grade TESL or EFL program. The Rock Point Study goes beyond the work of 
WilKnk, Shipp, and Stahl, whose work indicates that students' achievement in 
TESL curricula is superior to the achievement of students in monolingual 
English non-TESL curricula. The Rock Point Study indicated that combining 
a well-developed TESL program with instruction in Navajo—formulating a bi- 
lingual cxirriculum—creates an instructional climate in which students achieve 
beyond the levels of students in monolingual-TESL programs. 

The strongest support for the monolingual instruction is found in the 
Canadian studies. Two features of the Canadian programs need to be ex- 
amined. 

First, socioeconomic factors must be considered. The children in the 
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Canadian programs were upper and middle class children, whereas, the children 
in the Rock Point Study were from poverty backgrounds. The Canadian middle 
class students^ motivation to learn French may be much higher than the motiva- 
tion for Navajo children to learn English. 

Second, the cultural environment of the children in the Canadian programs 
was monolingual- bicultural-—children entered school speaking only English but 
lived in an environment of two distinct cultures in which both English and 
French were spoken. By contrast, the children in the Rock Point Study lived 
in a raonolingual-monocultural situation. The only cultural environment in 
which they regtilarly interacted was the Navajo culture, and Navajo was the 
dominant language; consequently, the opportunities to hear and use the second 
language were fewer for these children than for the children in the Canadian 
progframs. 

The monolingual instruction was effective with middle-class children in a 
bilingual environment. The Rock Point Study indicated that a bilingual 
approach was more effective in a non-middle class , monolingual-monocultural 
situation. 

Literature That Supports Bilingual Instruction 

Cottrell reports on a study of the effects of bilingual instruction on Navajo 
students attending school in San Juan County, Utah. An experimental and a 
control group were used in the study. The experimental group consisted of 
kindergarten and first grade students who went to school at three elementary 
schools on or near the resei^ation and who were in their first year of bilingual 
instruction. They received oral Navajo instruction, but no attempt was made 
to teach literacy in Navajo. The control group was composed of Navajo stu- 
dents who attended school in the Anglo commiinity of Blanding. Prior to the 
introduction of the bilingxial program, the Blanding students had consistently 
scored higher on standardized tests. The CaJifornia Test of Personality, an 
Oral English Response Test, and the Metropolitan Readiness Test were all ad- 
ministered. The experimental group scored equal to or higher than the con- 
trol group at both grade levels (1971). 

Hall reports on two early studies in the Philippines and in Sweden. The 
Iloilo I study conducted in the Philippines was organized m the siisne pattern 
as the Rizal study but was conducted 10 to 15 years earlier- The er^iperimental 
group received instruction in the vernacular during the ili*st t'wo je&xB and 
switched to English at third grade. The control group received monolingual 
EngHsh instruction only. At the end or the third grade, the experimental 
group was superior in oral English, reading, social studies, and adthraetic 
(1970). 

Venesky reports that at the sixth grade level, the Director of Public School 
Instruction in the Philippines ran an independent study with the same stu- 
dents. He found the control group to be superior in all areas (1970). Al- 
though the results of the Iloilo Study were somewhat confusing and contra- 
dicted the Rizal Study, the Philippine government instituted a national bi- 
lingual educational program as a result of the study. 

A Swedish study compared an experimental group which received 10 weeks of 
initial literacy in a local dialect before beginning reading in Swedish with a 
control group which received initial reading in Swedish only. At the end of 
the first year, the experimental students did significantly better in word 
recognition, speed, and accuracy in reading (Hall, 1970). 

Gudschinsky described several bilingual programs in Peru. The programs 
were located in two broad geographic areas — the mountain region and the 
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jungle region. In both situations, children spent the first two to three years 
in a bilingual curriculum. Content subjects and initial Uteracy were taught in 
the native language, and Spanish was taught as a second language. By the 
sixth grade level, the students introduced to Uteracy in the native language 
were far superior in Spanish reading to children who were taught in Spanish 
only (1971). Gudschinsky does not provide any statistical data to back these 
claims, and the results seem to be in conflict with the Pozzi-Escot study. 

Several studies have been conducted with Spanish speaking children in the 
United States. Although no studies have provided conclusive evidence of the 
effectiveness of the biUngual instruction , they have provided favorable indi- 
cators . 

Kaufman conducted a study in New York City with Puerto Rican seventh 
grade students. Two schools were used in the study, each having an experi- 
mental group and a control group. The two experimental groups received 
varying degrees of Spanish reading instruction; the control group continued 
in the monoUngual EngUsh program. The experimental group was superior in 
EngUsh reading in one school, and there was no difference in the groups at 
the other school. Kaufman concluded that there was some evidence of skill 
transfer in the one school (1968). Del Buono reports similar results with 
seventh grade Mexican-American students (1971). 

Covey conducted a similar study with high school freshmen in Phoenix. 
Experimental and control groups were established. The experimental group 
received more biUngual instruction than students in the Kaufman study did. 
Covey examined the effects of Spanish instruction on EngUsh, mathematics, 
and English reading performance. He found a significant difference in favor 
of the experimental group in all areas except mathematics (1973). The Umiting 
factor of these studies is that they did not focus on initial reading, which is 
the primary focus of the Rock Point Study; however, the impUcations of the 
studies are worth noting. 

A San Antonio study that focused on Mexican- American children in four 
schools has received national recognition. Experimental and control groups 
were established in each of four elementary schools. The experimental groups 
received initial Uteracy in Spanish; the control groups were introduced to 
reading in EngUsh. Pryor reported on the results at the end of first grade. 
In one school, the experimental group performed significantly higher in read- 
ing achievement. In two other schools, the experimental group scored higher, 
but not significantly so; in the fourth school, there was no significant differ- 
ence ( 1967) . Engle reported that testing at the end of the second year re- 
vealed no significant difference in the groups. The only other testing re- 
ported was a test of oral EngUsh proficiency, given during the fifth year of 
the project at the fifth grade level. The experimental groups scored higher 
than the control groups on the test (1975). 

Trevino investigated Mexican-American children's achievement in arithmetic, 
using a bilingual approach. The study covered a three-year period, beginning 
at the first grade level, where all the children received bilingual instruction. 
Each year, a new grade level was added and test results were compiled; at 
the end of third grade the investigation was completed. The children's per- 
formance was compared with previous students' performances and the national 
norm for the test. All but one third grade student scored at or above grade 
level. Prior to the introduction of the biUngual program, student achievement 
generally was well below the national norm (1970). 

Olesini studied the achievement of Mexican-American children at the third 
grade level, comparing those who had received at least two years of bilingual 
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instruction with those who were instructed in English only. He examined the 
achievement in several ciurric\ilar areas, including reading, and found a signifi- 
cant difference in favor of the bilingual students in all curricular areas except 
spelling and arithmetic computation. He concluded that bilingual children of 
both sexes achieved greater gains in the academic curricula when they were 
instructed by bilingual methods (1971). 

The study which is most often cited in support of bilingual instruction and 
which provides the clearest evidence of the effectiveness of the bilingual 
method is Modiano's Chiapas Study. Three Indian tribal areas in the high- 
lands of Chiapas, Mexico were used in the investigation. There were two 
school systems in the region. The state system provided the control group , 
which received instruction in Spanish only; students in the federal system 
comprised the experimental group and received instruction through a bilingual 
approach. Two instruments were used to measure reading comprehension in 
Spanish: teachers appraised each student's reading comprehension sldlls and 
Modiano developed a reading comprehension test. 

At the end of third grade, the experimental group scored significantly higher 
on both instruments. Modiano drew two major conclusions from her study, the 
first being that children taught to read in the native language learned two 
skills: reading and speaking a new language. The learning of the two skills 
was separated, however, because the children learned the skills of reading in 
a language in which they already were competent while they learned a second 
language (Spanish). After the children read proficiently in their native lan- 
guage, they transferred the skills of reading to the second language, in which 
they had developed a degree of oral proficiency. The children did not repeat 
reading readiness, but learned additional symbol /sound associations and reading 
rules unique to Spanish. 

Modiano's second conclusion was that the children taught in the national 
language (Spanish) only had to learn two skills; however, they were required 
to learn both skills in the same language~i.e. while they were developing pro- 
ficiency in a new language, they also were required to learn the skills of read- 
ing in that language (1966). The separation of learning the two skills—lan- 
guage learning and readings-formulates one of the important theories of bi- 
lingual education. Modiano' s work supported this theory that a child can learn 
both skills more proficiently if they are separated. 

These studies aU support bilingual instruction. The Olesini, Trevino, and 
Modiano reports all provide strong evidence of the effectiveness of this 
approach, and the Rock Point Study strengthens this body of supportive data. 
The Rock Point Study is significant from two perspectives: it covers more 
grade levels two through six than any of the studies reported, and it has a 
longitudinal aspect — achievement scores in reading were gathered for three 
consecutive years, and the pattern of achievement results remained consistent 
over the three-year period. 



Literature With Implications For Bilingual Education 

This section contains descriptions of studies and reports that have implica- 
tions for bilingual education or relate to the Rock Point Study. 

Odle compared reading achievement of Navajo eighth graders in three types 
of school systems. Type I was a system operated by the BIA exclusively for 
Indian children. Type II schools were public schools located on the Navajo 
reservation and operated by the state. Type III was the bordertown system, 
in which Navajo children are housed in one of the towns bordering the Reser- 
vation and attend the regular public schools. The students selected for the 
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study were Navajo language dominant; they were selected on IQ and age 
criteria. The basic instrument of the study was the SRA Achievement Survey. 

The results indicated that there was no significant difference in reading 
achievement between students in reservation pubUc schools and students in BIA 
schools. Odle did find a significant difference in achievement with the border- 
town students, who did better than students in both reservation pubUc schools 
and BIA schools. She concluded that this difference may have been due to 
the environment of the bordertown, where there was more opportunitv for ex- 
posure to English (1976). 

Bass found similar results in a national study of Native American students. 
He compared the achievement of Native American high school seniors who were 
in public schools, BIA schools, and mission schools. Navajo students were one 
of several tribal groups involved in the study. Bass found no significant 
difference in comparisons of pubUc school student achievement and BIA school 
student achievement; however, mission school students did score significantly 
higher (1969). The students in both the Odle and Bass studies were in mono- 
lingual EngUsh programs. There is no record of any of these students par- 
ticipating in a bilingual program. 

The Soviet Union has had established bilingual programs since the revolution. 
Kreusler described some of the effects of these programs. The bilingual ap- 
proach has allowed the Soviets to introduce Russian in areas where the Csars 
were unable to do so. They have been able to unite the country by using in- 
struction in the local vernaculars to acculturate the minorities (1961). 

Bingham seems to support Kreusler's conclusions and notes two important 
additional points. In northern Siberia, the people have traditionally been iso- 
lated from the rest of the country; however, since the revolution, with the 
introduction of bilingual education, this region has produced many profes- 
sionals—such as engineers, doctors, and teachers. Also, in two areas of the 
north, the biUngual programs have deteriorated in favor of monolingual Russian 
schools. The national education ministry found that since this change these 
areas now have a high dropout rate, and students' academic achievements are 
inferior to that of students where quality bilingual programs have been main- 
tained (1975). 

Macnamara studied the reading ability of compound bilinguals and compared 
the children's reading ability in their stronger language with their reading 
ability in their weaker language. Three groups of children were studied: 
two groups were composed of compound English-Gaelic bilinguals and the other 
•jroup was composed of compound English-French bilinguals. All the students 
in the investigation were dominant in English. The experiment involved 
several reading tasks such as problem solving, speed reading, and analyzing 
reading selections. 

The experiments demonstrated that children could read and solve problems 
faster in the stronger language. Significant differences between the stronger 
and weaker languages were found in the interpretation of the words and sen- 
tences, the pronunciation of words, and the ability to anticipate the sequence 
of words. Macnamara concluded: 

. . . the slower rate in the weaker language does not allow any added 
leisure time for thinking about what is read . . . the time is fully em- 
ployed on the task of decoding language. Consequently, some important 
points may slip his mind . . . (as) difficulty of the problem increases a 
man is more likely to fail. (1970) 

Lum compared two approaches for teaching English to Chinese students, 
focusing on the development of English oral proficiency. Conducted in San 
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Francisco, the study compared students who were in bilingual programs with 
those in an EFL direct method program. The students were tested at the end 
of first grade. The students that were taught using the EFL direct method 
were approximately six months ahead of the bilingual students in oral English. 
Lum believes this to be the direct result of language interference. Students 
in the bilingual program were having structural interference reinforced by the 
use of Chinese in the classroom (1971). 

A study conducted in Ghana provides some insight into what may occur when 
a child who speaks limited English, no English, or a nonstandard dialect of 
English is confronted with a monolingual standard-English curriculiim. The 
study was based on Vygotsky's work (1965). A hierarchy of four levels of 
thought development was established following Vygotsky's suggestions of cog- 
nitive maturation. Ghana has two major native language regions; English is 
the national or business language, and, in many areas, English is the language 
of instruction in the classroom. 

Collison, the researcher, set up a series of science-related activities requir- 
ing thinking that involved all four levels of thought development. CoUison 
performed the activities separately in English and in each of the regional lan- 
guages. The activities were not language bound— i.e. they could be dis- 
cussed in any language. The students in the study were from 13 to 15 years 
of age, and all were dominant speakers of one of the regional languages. 
Collison tape-recorded the discussion periods, and analyzed the student re- 
sponses in English and the native languages. The remarks of the students 
were classified into each of the four levels of thought development. 

The results of the study showed that student responses in English were 
limited to the first and second levels of thought development, with the majority 
at the most simple level. In the native lar^guages, the student responses re- 
flected thought development at all levels, with the majority of responses at 
the second and third levels. Collison beUeved that limited ability to speak 
English had a direct effect on cognitive development. The basic conclusion 
was that the children must understand the language of instruction to f\illy 
develop their cognitive processes (1974). 

Collison's work seems to indicate that language and thought development are 
interdependent. This hypothesis is supported by the work of Bruner (Wilson, 
1973) , Vygotsky (1965), Bernstein (1964), Luria (1968), and Blank (1974). 
The implications suggested by these studies either are supported by the Rock 
Point Study or suggest concepts that reflect on the Rock Point Study but need 
further investigation. 

The Rock Point Study focuses essentially on BIA schools. The Bass and 
Odle reports provide a bridge for extending the implications of the Rock Point 
Study to Navajo students in public schools. The type of school system- 
public or BI A—seemed to have no effect on student achievement. The impli- 
cations of the Rock Point Study are that the type of curricular program is 
more significant than the type of school system. The achievement of children 
in public schools should increase through the use of bilingual programs. 

Macnamara's work has more interesting implications. Students read better 
(comprehend more) in their strongest language; therefore, if students are to 
have the best opportunity for developing comprehension skills, these skills 
should be developed in the student's strongest language. The Rock Point 
Study supports this conclusion. The data collected through the comprehen- 
sion subtests indicate that if children first learned compreVvsnsion skills well 
in Navajo, then these skills transferred to English. 

The results of reading achievement in Navajo cannot I i compared by the 
use of standarr:-.i^>d tests, since no standardized reading tests are available 
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m Navajo. But one measure of achievement is the difficulty of reading 
materials for a given grade level. The most difficult material in print in 
Navajo, in terms of vocabulary and content, is the Navajo Histoncal Selec- 
tions, first printed in 1948. The booklets are transcriptions of taped inter- 
views with influential Navajo leaders of that period and were designed for 
adult readers. By April of 1975, the average third grader at Rock Point 
could read any of the Selections proficiently. This achievement was far beyond 
the expectations of the teachers, administrators, and project personnel 

Lum's study follows the pattern described in the first section of this Appen- 
dix. The initial year of bilingual instruction provides Uttle evidence that such 
instruction is more effective than monolingual instruction. The Rock Pdnt 
children scored lower than the children in the EFL direct method programs at 
the second grade level. This study strengthens the conclusion that more than 
a few years of bilingual instruction are needed to show significant results. 

Collison's report suggests the need for further investigation of the role of 
language and cognitive development. Vygotsky may be correct; if he is, then 
the language of instruction is more significant than American educators have 
been willing to acknowledge, Collison's experiment impHes that the language 
of instruction is important if children are to develop cognitive skills fully. 
The Rock Point Study supports Collison's work as foUows: the Rock Point 
children seem to have transferred skills to the point that they achieved in 
English reading and arithmetic beyond the levels of children taught onlv in 
English. 



NOTES 



1. Elizabeth W. Willink, personal interview, December 30, 1976. 

2. Richard Stahl, personal interview, September 17, 1976. 

3. The Navajo Historical Selections were put out by the Bureau of Indian 
Affairs and later were included in the University of New Mexico's Navalo 
Reading Study. 
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This appendix is composed of a description of the study's methodology and the 
findings of the study, which include the statistical analyses. The information 
in these two sections came essentially from the dissertation "A Comparative 
Study of Two Approaches of Introducing Initial Reading to Navajo Children: 
The Direct Method and the Native Language Method" (Rosier, 1977). The sec- 
tions have been modified by adding the methodology used for the arithmetic 
and English proficiency components and the findings of these two components. 

Portions of the "Findings" chapter of the dissertation were not included (the 
boys compared to boys and the girls compared to girls); therefore, the number- 
ing of tables in the findings section of this Appendix is not completely sequen- 
tial. There Me gaps where the tables displaying the boy-giri comparisons are 
not included. In all cases the tables have discrete identifying numbers, i.e. 
no two tables have the same niimber. The tables are grouped at the end of 
the Appendix. 

METHODOLOGY 

Introduction 

Several studies have been conducted that relate to the problem of this in- 
vestigation, but only a limited number of researchers have made comparisons 
between the bilingual method and the EFL direct method. Usually, compari- 
sons between one of the two methods and the standard curriculum have been 
made, e.g. a comparison between bilingual students taught using TESL tech- 
niques and bilingual students taught using a curriculum primarily designed 
for native EngUsh speakers. This chapter is an outUne of a research design 
that allowed for a comparison of the two methods. 

The design of the study was structured after the Post-Test-Only Control 
Oroup Design model described by CampbeU and Stanley (1966). This model 
was modified to meet existing conditions. Two divergences from the model 
were required: the participating schools were selected based on curricular 
criteria and were not randomly selected, and two control groups were used 
rather than one in the reading component of the study. The two groups are 
referred to as the baseline control group and the concurrent control group. 
The criteria for selecting participants and a description of the two control 
groups are presented in the following sections. 

Population and Sampling 

The experimental group in this study was limited to Rock Point Community 
School. Since the validity of this study depends on the matching of the 
students in the control groups vlJ^i the students in the experimental group. 
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a brief description of the organization and curriculum of the experimental 
school is provided. 
From kindergarten through second grade the classrooms were organized as 
coordinate bilingual classrooms." Each class had two teachers. The Navaio 
Language Teacher (NLT) used Navajo for instruction and introduced initial 
hteracy in Navajo. AU content areas were introduced in Navajo first The 
English Language Teacher (ELT) used EngUsh for instruction and taught the 

thf PT T f ^^P^v!"^'^^ f-^l^'f ^^""^^ language techniques. In addition, 
the ELI taught the Enghsh for arithmetic concepts introduced in Navaio. At 
the second grade level, the ELT introduced English reading, and the class- 
g^age "^""^ °rg^zed into language areas, half of the classroom for each lan- 

A homeroom, departmentalized program was used from third through sixth 
grade. The homeroom had one teacher, an ELT, and the language of instruc- 
faon was Enghsh. The ELTs at these levels continued to use TESL techniques. 
The curriculum was limited to language arts, arithmetic, and, if time were 
available, English social studies. Children left the homeroom in half-class 
groups to attend departmentalized subjects in Navajo, including Navajo Uteracy 
(language arts), science taught in Navajo, and Navajo social studies 

The time spent for instruction in each language varied among grade levels. 
In kindergarten, 70 percent of the instruction was in Navajo. For beginners 
(Six-year-old children who were unable to attend kindergarten or who did not 
meet the kindergarten objectives) and first and second graders, approximately 
50 percent of the instructional time was in each language. For third through 
sixth graders, 75 percent of the instruction was in English. 

The two control groups included selected samples of students in BIA schools 
on the Navajo Reservation. These schools used the EFL direct method. Both 
control groups were composed of five schools, which were selected usine: the 
following criteria: 

(1) The schools had a program which included grades kindergarten through 

(2) The schools had an established CITE, NALAP, or other recognized TESL 
program. 

(3) There were two people per classroom involved in instruction in grades 
kindergarten through second. This was either a teacher- teacher relationship 
or a teacher-teacher aide relationship, but both people actually provided in- 
struction. 

(4) At least one of the two instructors had native competence in Navajo. 

(5) The index of language dominance of entering six- year-olds for each 
school was within the limits of 3.48 to 5.00. Data were collected on entering 
six-year-olds in over 90 percent of the BIA schools in more than 50 percent 
of the public schools on the Navajo Reservation. From the data gathered, 
Spolsky developed a scale of language dominance and assigned each school an 
index number. The index scale ran from 1.00, which represented a school 
100 percent English dominant, to 5.00, which represented a school 100 per- 
cent Navajo dominant. The experimental school's index was 4.24 (Soolskv. 
1971). ^ 



Data Collection 



There were two comparisons used in the reading component. The first com- 
pared the experimental group with the baseline control group. The control 
group in this case was tested in February, 1975 to estabUsh baseUne data. 
The experimental group was also tested at that time and was tested again in 
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February, 1976 and February, 1977. The instrument used in this comparison 
was the Stanford Achievement Test (SAT) , 1973 edition. 

All administrations of the test were considered post-tests. Scores from 
three subtests—Word Study Skills, Reading Comprehension, and Total Read- 
ing~v/ere used. The following levels of the Stanford Achievement Ttist were 
given: (1) the Primary I Level was given to the second grarle; (2) the Pri- 
mary II Level, to the third grade; (3) the Primary III Level, to the fourth 
grade; ^ (4) the Intermediate I Level, to the fifth grade; (5) the Intermediate 
II Level, to the sixth grade. 

The second comparison was between the experimental group and the con- 
current control group. Both groups were tested over a one-year period. The 
BIA school system and Rock Point Community School both administered the 
Metropolitan Achievement Test (IVIAT) system-wide in April, 1976; this adminis- 
tration was considered a post- test. All children in the control and experi- 
mental groups in grades second through sixth were tested. Three scores 
were gathered — Word Knowledge, Reading Comprehension, and Total Reading. 
The following levels of the Metropolitan Achievement Test, 1971 edition, were 
administered: (1) the Primary I Level was administered to the second grades; 
(2) the Primary II Level, to the third grades; (3) the Elementary Level, to 
the fourth and fifth grades; (4) the Intermediate Level, to the sixth grades. 

The baseline comparison was also used for the arithmetic portion of the 
study. The Stanford Achievement Test was used to measure arithmetic achieve- 
ment of students in both groups, which were tested in February, 1975. Scores 
at the second grade level were gathered from the Total Arithmetic, Computation, 
and Application subtests. For the third through fifth grade levels, scores 
were gathered from Total Arithmetic, Concepts, Computation, and Application 
subtests. The same levels of the SAT as listed previously were administered 
at each grade level. 

The English proficiency component was a comparison of the achievement of 
Rock Point students with Chinle Agency student achievement and with the 
achievement of Navajo Area students. The Navajo Area and Chinle Agency 
schools administered the Test of Proficiency in English as a Second Language 
(TOPESL) test to all children in grades four through six in 1974. Rock Point 
administered the TOPESL Test in 1975 and 1976 to all students in fourth 
through sixth grades. Two subtests of the TOPESL~the Listening Compre- 
hension Test and the English Structure Test — were administered to all chil- 
dren. The data gathered from Rock Point in 1975 and 1976 were compared 
with the Navajo Area and Chinle Agency 1974 data. 

Statistical Analysis 

Data were collected for each of the two comparisons in reading — the experi- 
mental group and the baseline control group; the experimental group and the 
concurrent control group. Reading grade-level-equivalent scores of each stu- 
dent in the study were collected for (1) each of the three test areas — Word 
Knowledge or Word Study Skills, Reading Comprehension, and Total Reading; 
(2) each grcde level at each school; and (3) each year of the study. Arithme- 
tic griide^level-equivalent collected for each student in the follow- 
ing test areas: Concepts, Computation, Application, and Total Arithmetic. 
These were collected at each grade level except second grade, where no 
scores were reported for Application. 

There are two exceptions to the above description. Two of the control 
schools, one in each of the two control groups, did not report scores for a 
particular grade level. One grade level was not reported in each case. 
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OveraU, this had no significant effect on the number of participants in the 
control groups. Both control groups contained over 200 scores at each of the 
two grade levels where scores were not reported. The second exception con- 
cerns the sixth grade level of the experimental group in the baseUne compari- 
son. The experimental school reported only six scores the first year of the 
comparison (1975); therefore, no comparison of the control group and the ex- 
perimental group was possible at the sixth grade level for the first year. 
Sufficient scores were reported at the sixth grade level for the succeeding 
two years of the study (1976 and 1977). 

As noted earlier, the Primary m Battery of the Stanford Achievement Test 
was not available for the first year of the baseline comparison, but it was 
given to the experimental group in 1976 and 1977. Since the baseline group 
was only tested once, in 1975, it was necessary to make an adjustment in the 
baseline control group data at the fourth grade level—the level at which the 
Primary III test was supposed to be administered. The adjustment was made 
by subtracting the third grade mean scores from the fifth grade mean scores 
of each control school and dividing them in half. The resulting figure was 
added to the individual 1975 third grade scores for each of the three test 
aroas for each control school. This was accomplished by using the Statisti- 
cal Package for the Social Sciences (SPSS). The adjustment was used as the 
control group fourth grade standard. The experimental group scores for 
1976 and 1977 were compared against this standard. 

The data gathered using the MAT were converted to SAT grade-level- 
equivalents using a conversion table (Stanford Research Report, 1973). This 
conversion of MAT scores to SAT scores was completed before the data were 
analyzed statistically; consequently, all data reported in this study are in 
the form of grade-level-equivalents based on the Stanford Achievement Test, 
1973 edition. The data gathered for each of the two comparisons were inde- 
pendently analyzed, and the data collected each year of the study also were 
analyzed separately. Comparisons between the years of the study and be- 
tween the two sets of data were made and significant trends reported. 

The data for aU comparisons of reading and arithmetic v/ere statistically 
analyzed by use of a T-test. The T-test was used to analyze the difference 
of the means of each school and the means of the experimental group and 
each of the control groups. The T-test was selected because it is a para- 
metric test, and parametric tests are considered to be more power-efficient 
than non-parametric tests (Ferguson, 1976). The assumptions of a T-test 
may be significantly violated without affecting the result of the test (Baker, 
1966). The comparisons, though numerous, required the comparing of only 
two means in any given situation; therefore, a T-test was more efficient than 
a simple analysis of variance which coiild have been used. 

The NAU Xerox Sigma 6 Computer with the software SPSS was used to cal- 
culate T-scores for reading; the University of New Mexico IBM computer with 
the software SPSS was used to calculate T-scores for arithmetic. The SPSS 
Subprogram T-Test: Comparison of Sample Means was used to calculate T- 
scores; the specific program used to calculate T-scores was the Comparison 
of Means — Independent Samples Populations with Common Variance. The 
following formulas were used in this program (Nie, 1975): 
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The .05 level of confidence was used as the criterion level for determining 
significant difference; this level was selected because it is a recognized 
standard. The English proficiency component of the study did not reqirire 
a statistical analysis. A visual analysis of the mean scores was conducted. 

FINDINGS OF THE STUDY 



The primary purpose of this study was to compare two approaches for in- 
troducing reading in English to Navajo children. The EFL direct method 
approach introduced children to reading in English only? systematic TESL 
techniques were used in this approach. Children received at least one year 
of instruction in oral English before beginning actual reading in English. 
The bilingual method approach introduced children to reading in Navajo first. 
The children developed reading proficiency in the native language before 
they were transferred to English reading. These children developed an oral 
proficiency in English while they were learning to read in Navajo. 

The assessment of the reading component of the study involved two sepa- 
rate comparisons, which will be referred to in this chapter as the baseline 
comparison and concurrent comparison. The baseUne comparison required 
testing over a three-year period at grades two through six. The concurrent 
comparison was composed of data collected over a one-year period. The test- 
ing conducted in this comparison included grades two through six. 

The statistic selected to analyze the data collected was a T-test of the 
difference in the means of the experimental group and the control groups. 
The T-test statistic was used in both the baseline and concurrent compari- 
sons. The appropriate T-value is reported for each comparison of the ex- 
perimental gfroup and the control group. The T-value reported for a given 
comparison is either a T-value where the variance was pooled or a T-value 
where the variance was separate. The criteria for determining which T-value 
is reported was whether the f ratio of the experimental group^s variance and 
the control group^s variance was significant or not significant. If the level of 
significance of the f ratio was larger than the .05 level of significance, the 
T-value for pooled variance is reported. If the level of significance of the 
f ratio was at the .05 level of significance or smaller, the T-value for sepa- 
rate variance is reported. 

The findings of the reading component are presented in the following organ- 
izationj4 fom data is presented for each of the two comparisons 

separat^y . The baseline compariTO first r followed by the 

concurrent comparison findings. A common sequence for presenting the find- 
ings is followed in both comparisons. The sequence is derived from the hy- 
potheses established in the problem of the study. The sequence is as follows: 
(1) comparison of achievement in total reading at each grade level (second 
through sixth); (2) comparison of achievement in the sub-sldU areas of word 
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knowledge skills or word study skills and of comprehension at each grade 
level (second through sixth); (3) comparison of growth rates in total reading. 

Baseline Comparison. The data presented in this section were collected over 
a three-year period. The experimental group was tested in February, 1975, 
February, 1976, and February, 1977. The control group was tested once~in 
February, 1975. Each year's data of the experimental group are compared to 
the 1975 data of the control group, except at the fourth grade level. There- 
fore, there are three separate sets of comparisons in this section, one set 
for each year. The three sets of data for a particular comparison are pre- 
sented and described together, e.g. the three T-test analysis tables of data 
for the comparison of student achievement in total reading at the second 
grade level are displayed and discussed as a unit. 

The T-test analysis of comparisons between the second grade experimental 
group and the second grade control group in total reading achievement appear 
in Tables 2, 3, and 4. Table 2 shows that the control group scores were 
significantly higher than the experimental group scores in 1975. Table 3 and 
Table 4 display the 1976 and the 1977 comparison results. The control group 
scores were higher than the experimental group scores both years, but the 
differences in the scores were not significant. 

Tables 5, 6, and 7 display the T-test analyses of the third grade level 
comparisons in total reading. The experimental group scores were higher 
than the control group all three years. Table 6 shows that the experimental 
group scores were significantly higher in 1976, but a significant level was 
not reached in 1975 or in 1977 as indicated in Tables 5 and 7. 

The T-test analyses of the fourth grade comparisons in total reading appear 
in Tables 8, 9, and 10. The experimental group scores were significantly 
higher than the control group scores in 1975 and 1976, as depicted in Tables 
8 and 9. The T-values for both years were beyond the . 001 level of signifi- 
cance. Table 10 shows that the experimental group scores were higher than 
the control group scores in 1977, but the difference in the scores was not 
significant. 

Tables 11, 12, and 13 display the T-test analyses of the fifth grade com- 
parisons for each year of the study. The experimental group scores were 
significantly higher than the control scores all three years. The T-values 
were aU beyond the .001 level of significance. The T-test analyses for the 
sixth grade comparisons are exhibited in Tables 14 and 15. No comparison 
was conducted for 1975 at the sixth grade level. The experimental group 
scores were significantly higher than the control group scores in both 1976 
and 1977. The T-values were both beyond the .001 level of significance. 

The comparisons of second grade students in word study skills appear in 
Tables 16, 17, and 18. Tables 16 and 17 show that the control group scores 
were significantly higher than the experimental group scores in 1975 and 1976. 
The control group scores were higher than the experimental group scores in 
1977, but the scores were not significantly higher. Tables 19, 20, and 21 
display the T-test jinalyses of comparisons of second grade students in com- 
prehension skills. The control group scores were higher than the experi- 
mental group scores all three years, but only in 1975 (Table 19) were the 
control group scores significantly higher than the experimental group scores. 

The T-test analyses of the comparisons of third grade achievement in word 
study skills are exhibited in Tables 22, 23, and 24. The experimental group 
scores were higher than the control groups' scores all three years, but the 
.05 level of significance was reached only in the 1976 comparison (Table 23). 
Tables 25, 26, and 27 display the T-test analyses of the comparisons of 
achievement in comprehension skills of third grade students. There was no 
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difference in the mean scores of the experimental group and the control group 
ui 1975 (Table 25). The experimental group scores were higher than the con- 
in 1976°"^ scores in 1976 and 1977 (Tables 26 and 27) and significantly higher 

The comparisons of fourth grade student achievement in word study skills 
appear in Tables 28, 29, and 30. The T-test analyses of these comparisons 
indicate that the experimental group scores were significantly higher than 
control group scores in aU three years of the study. The T-test analyses 
of the comparisons of achievement in comprehension skiUs are exhibited in 
Tables 31, 32, and 33. Tables 31 and 32 show that the experimental group 
scores were higher than the control group scores and were beyond the . 05 
level of significance in 1976 (Table 32). The 1977 experimental group scores 
were below the control group scores but the difference was not significant. 

Tables 34, 35, and 36 display the T-test analyses of the comparisons of 
achievement in word study skills of fifth grade students. The three tables 
show that the experimental groups' scores were significantly higher than the 
control group scores all three years of study. The level of significance for 
the three T-values displayed in these tables was beyond the .001 level. The 
T-test analyses of the comparisons of achievement in comprehension skills ap- 
pear in Tables 37, 38, and 39. The experimental group scores were higher 
than the control groups' scores all three years. Tables 37, 38, and 39 show 
the differences in the means were significant in all three comparisons. 

The comparisons of sixth grade achievement in word study skills appear in 
Tables 40 and 41. The T-test analyses of each of the comparisons indicates 
that the experimental group scores were significantly higher than the control 
group scores in 1976 and 1977. The difference in the means in each of the 
comparisons was significant beyond the . 001 level. Comparisons of sixth 
grade achievement in comprehension skills are exhibited in Tables 42 and 43. 
These tables show that the experimental group scores were higher than the 
control group scores in 1976 and 1977. The difference in the means in both 
comparisons was significant at or beyond the .001 level. 

The rates of growth of the experimental group and the control group were 
not statistically analyzed. They were determined in the following manner: 
the grade- level- equivalent score mean of the lowest grade was subtracted 
from the grade -level- equivalent score mean of the highest grade; the differ- 
ence was then divided by the number of years of growth. The following is 
an example of the computation procedures. 

Highest grade: sixth grade mean 
Lowest grade: second grade mean 

Number of years of growth: 4 years 

4.69 T 4 = 1.18 growth rate 

Graph 1 shows that the growth rate of the experimental group in 1975 was 
1.07; the control group growth rate that year was .42. The growth rates 
of the experimental group and control group were 1.18 and .50 respectively 
in 1976 (Graph 2). The growth rate of the two groups in 1977 (Graph 3) 
was- .99-for the experimental group and . 50 for the control group. 

Concurrent Comparison. The concurrent comparison involved a one-year 
period. Students in both the experimental group and in the control group 
were tested in April, 1976. The Metropolitan Achievement Test (MAT) was 
the instrument used to test student achievement. The MAT scores were 
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Graph 1 

Baseline Comparison 1975: 
The Gro'wth Rates of the Experimental Group and the Control Group 
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Graph 2 

Baseline Comparison 1976: 
The Growth Rate of the Experimental Group and the Control Group 




1.5 - 



I I I 1 1— 

2nd 3rd 4th 5th 6th 

Grade Level 



56 



Rock Point 



Graph 3 

Baseline Comparison 1977: 
The Growth Rates of the Experimental Group and the Control Group 
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reported in the form of grade- level- equivalent scores. The MAT grade- 
level- eqvdvalent scores were converted to Stanford Achievement Test (SAT) 
grade -level- equivalent scores. Therefore, the data presented in this sec- 
tion are consistent with the data presented in the baseline comparison. 

The format of this section is similar to the format of the previous section. 
The primary difference is that this section presents data collected over a 
one-year period, rather than over a three-year period. The data presented 
in this section was analyzed using a T -test to determine if the difference in 
the means of a given comparison of the experimental group and the control 
group was significant. 

The comparison of the second grade students' achievement in total reading 
is exhibited in Table 72. The T-test analysis showed no significant differ- 
ence in the groups' means, but the control group scored higher than the 
experimental group. Table 73 displays the T-test analysis of the comparison 
of the third grade students in total reading. The analysis indicated that the 
experimental group scored significantly higher than the control group* The 
T-test analysis of fourth grade students' achievement in total reading appears 
in Table 74. The experimental group scores were significantly higher than 
the control group scores. 

The comparison of fifth grade students' achievement in total reading appears 
in Table 75. The T-test analysis of the difference in the mean of the experi- 
mental group and the mean of the control group showed that the experimental 
group mean was significantly higher than the control group mean. 

Table 76 displays the comparison of sixth grade students in total reading. 
The T-test analysis indicated that the experimental group scored significantly 
higher than the control group. 

Table 77 contains the comparison of second grade students' achievement in 
word knowledge skills. Table 78 displays the comparison of second grade stu- 
dents' achievement in reading comprehension. The control group scored 
higher than the experimental group in both comparisons. The T-test analy- 
ses of both comparisons showed that the differences in group means were not 
significant. The comparison of third grade students' achievement in word 
knowledge skills is exhibited in Table 79. The comparison of third grade 
student achievement in reading comprehension appears in Table 80. The T- 
test analyses in Table 79 and in Table 80 revealed that the experimental 
group scored higher than the control group, but the difference in the scores 
was not significant in either comparison. 

The T-test analyses of the comparisons of fourth grade student achievement 
in word knowledge skills and in reading comprehension appear in Tables 81 
and 82. The results of the analyses indicated that the experimental group 
scores were significantly higher than the control group scores in both compar- 
isons. The comparisons of fifth grade students' achievement in word knowl- 
edge skills and in reading comprehension appear in Tables 83 and 84. The 
T-test analyses of both comparisons indicated that the experimental students' 
achievement was significantly higher than the control students' achievement. 
The results of both comparisons are significant beyond the .001 level. 

Table 85 depicts the comparison of sixth grade students' achievement in 
word knowledge skills. Table 86 displays the comparison of student achieve- 
ment in reading comprehension. The T-test analyses of both comparisons 
showed that the experimental group achievement was significantly higher than 
the control group achiievement. The T- values in both comparisons were sig- 
nificant beyond the .001 level. 

The growth rates for the concurrent comparison were determined using the 
same procedures described for the baseline comparison. No statistical 
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analysis was used to compare the growth rate of each group. 

Graph 4 displays the growth rates for each group and the national norm. 
The control group growth rate was .52. The experimental group growth 
rate was .84, and the national norm growth rate was 1.00. 

Summary. The analysis of the reading achievement data provides the 
tollowing results, which are expressed in general statements. These results 
are based on both the baseline comparison and the concurrent comparison and 
on data collected over a three-year period. 

(1) The comparisons conducted at the second grade level revealed that the 
control group achievement generally was higher than the experimental group 
achievement. The control group scores were significantly higher than the 
experimental group scores in six of 20 comparisons made at the second grade 
level. ^ 

(2) The comparisons at the third grade level showed that the experimental 
group achievement generaUy was equal to or greater than the control group 
achievement. The experimental group means were significantly higher than 
the control group means in six of 20 comparisons. 

(3) The comparisons of achievement at the fourth grade level revealed that 
generally the experimental group scores were higher than the control group 
scores. The experimental group means were significantly higher than the 
control group means in 15 of 20 comparisons. 

(4) The fifth grade level comparisons showed that the experimental group 
means were significantly higher than the control group means in aU 20 com- 
parisons. 

(5) The sixth grade level comparisons revealed that the experimental group 
scores were significantly higher than the control group scores in aU 15 com- 
parisons . 



Arithmetic 



The arithmetic component of the study was a comparison of achievement of 
children who were initiaUy introduced to arithmetic in Navajo with children 
who were introduced to arithmetic in English only. The comparison was con- 
ducted in February, 1975, and children in grades two through six were 
tested. The test instrument was the Stanford Achievement Test, and four 
subtests were administered— Arithmetic Concepts, Arithmetic Computation, 
Arithmetic Application, and Total Arithmetic. The subtest Arithmetic Appli- 
cation was not available for second grt-Ie. 

The data gathered were analyzed with a T-test, using the program contained 
in the computer software SPSS. The data at each grade level are presented 
in the following subsections: comparisons in total arithmetic and comparisons 
in the subsMlls. The T-test value report is the appropriate value for a par- 
ticular comparison. Pooled variance scores were used if the f ratios were at 
.06 or greater levels of significance; separate variance scores were reported 
if the f ratios were at .05 or less levels of significance. 

Comparisons in Total Arithmetic. Table 101 provides a description of the 
comparison of the second grade experimental and control groups in total 
arithmetic. The control group mean score was significantly higher than the 
experimental group. The comparison of third grade student scores in total 
arithmetic appears in Table 102^ The control group scored slightly higher, 
but not significantly higher, than the experimental group. The comparison 
of fourth grade students in total arithmetic achievement appears in Table 103. 
The table shows that the experimental group scored significantly higher. The 
T -value was 3.22 which is beyond the .05 level of significance. Table 104 
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depicts the comparison of fifth grade student scores. The experimental 
poup students scored significantly higher than control group students. The 
level of fagmficanee of the T- value was beyond the .001 level. 

Comparisons In the Subskills. Tables 105 and 106 display the comparisons 
Of second grade students in arithmetic concepts and arithmetic computation. 
The control group scores were higher on both subsWUs comparisons. The 
control group scor-es were significantly higher on arithmetic concepts. The 
oorapansons of third grade students in arithmetic concepts, arithmetic compu- 
tauon, and arithmetic application appear in Tables 107, 108, and 109. The 
cwitrol ^oup scored higher than the experimental group on all three sub- 
sMlls. Trie control group scores were significantly higher on arithmetic 
appjicatton. 

The comparisons of fourth grade students in arithmetic concepts, arithmetic 
computation, and arithmetic application are displayed in Tables 110, 111, and 

112. The experimental group scored higher than the control group in all 
three comparisons. The experimental student scores were significantly higher 
1^0 °^ arithmetic concepts and arithmetic computation. Tables 

113, 114, and 115 exhibit the comparisons of fifth grade students in arithmetic 
concepts, arithmetic computation, and arithmetic application. The experimental 
group scores were significantly higher in all three comparisons. No sixth 
grade comparisons were conducted because only six scores were reported for 
the experimental group at this level. 

Summary. A summary of tho comparisons of student achievement in arith- 
metic appears in Table 116. The control group scores were higher than the 
experimental group scores at the second and third grade levels. The control 
group scores were significantly higher than the experimental group scores in 
three of seven comparisons at these levels. At the fourth and fifth grade 
levels the experimental group scored higher than the control group in all 
eight comparisons. In seven of these comparisons, the experimental student 
scores were significantly higher. 

English Proficiency 

The English proficiency component was a comparison of the achievement of 
Rock Point students with Chinle Agsncy student achievement and with Navajo 
Area student achievement. The Test of Proficiency in English as a Second 
Language (TOPESL) was administered to all students in grades four through 
six. The Navajo Area and Chinle Agency schools administered the test in 
1974; Rock Point administered the test in 1975 and 1976. The data gathered 
for each year at Rock Point were compared to the 1974 data gathered at 
Navajo Area and Chinle Agency schools. A visual analysis of the data is 
provided . 

The TOPESL test is intended as a measure of proficiency in English for 
non- native speakers and has three subtests- -English Structure, Listening 
Comprehension, and Oral Comprehension. In this case, only the first two 
were used. The English Structure test has a maximum of 62 points, the 
Listening Comprehension test, 40 points; the scores have been converted to 
percentages to allow comparison. The TOPESL has little "top"--it was normed 
on native speakers of English of the same age , and native speakers should 
achieve almost 100 percent. 

The results of the comparisons of Rock Point students and the Navajo Area 
and Chinle Agency students appear in Tables 117 and 118. A comparison of 
the Rock Point 1975 student achievement and the Chinle Agency and Navajo 
Area 1974 student achievement is presented in Table 117. The comparison on 
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the subtest English Structure shows that Rock Point fourth graders' mean 
score was equal to the mean score of the Navajo Area sixth graders. Rock 
Point fourth graders, on the average, scored higher than the Chinle Agency 
sixth grade student average score. 

The comparison on the Listening Comprehension subtest reveals that the 
Rock Point fourth grade mean score is higher than both the mean scoi^e of 
the Navajo Area and the mean score of the Chinle Agency. Rock Point 
fourth graders scored 19 percentage points higher than the Chinle Agency 
fifth graders and 10 percentage points higher than the Navajo Area fifth 
graders. Table 118 displays a comparison of 1976 Rock Point achievement 
with the 1974 Chinle Agency and Navajo Area achievement. At each grade 
level Rock Point mean scores are higher than Navajo Area or Chinle Agency 
mean scores. 

The achievement of Rock Point students was higher than the achievement 
of both Navajo Area and Chinle Agency students at all grade levels tested. 
In 1975, Rock Point fourth graders scored as high as or higher than the 
Navajo Area sixth graders in English proficiency. Both in 1975 and 1976, 
Rock Point fifth graders scored substantially higher than Navajo Area sixth 
graders on both subtests. 

NOTES 

1. For these tables, see the dissertation, which is available on microfilm 
through University Microfilms, Ann Arbor, Mich., and which is listed in 
Dissertation Abstracts International A: Humanities and Social Sciences 
38:1167. 

2. The Primary III Level was not available from the publisher in 1975. 
The Primary II Level was administered to the fourth grade that year, but the 
Primary III Level was given in 1976 and 1977. 
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Table 2, Baseline Compdson 1975; 
Smms in Total Reading. 



T-Test Analysis of Grade- 



i-Level-£quivQlent Scores of Second Grade 



Number of 
School Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of Level of 
Freedom Significance 


Experimental Group 44 
Control Group 215 


1.90 
2.16 


.44176 
.64063 


-3.35 


92 .001 


Table 3. Baseline Comparison 1976; T-Test Analysis of Grade-Level-Equivalent Scores of Second Grade 
Students in Total Reading, 


Number of 
School Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of Level of 
Freedom Significance 


Experimental Group 31 
Control Group 215 


1.94 
2.16 


.49713 
.64063 


-1.82 


244 .071 


Table 4. Baseline Comparison J977; 
Students in Total Keadingf. 


Mest Analysis of Grade-leveHquival 


ent Scores of Second Grade 


Number of 
School Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of Level oi 
Freedom Significance 


Experimental Group 25 
Control Group 215 


2.02 
2.16 


.74537 
.64063 


-1.02 


238 .308 



n 



Table 5. Baseline Compmon 1975; Mest hmlysis of Grade-LeveHqufvalent Scores of Third Grade 
Students in Mai Reading. 



Number of Standard Degrees of Level of 

School Cases Mean Deviation T Value Freedom Significance 

Experimental Group 54 2.31 ,46068 . «c ... ... 

Control Group 220 2.22 .65690 ^'^ '^^^ 



Table 6. Boseline Comparison 1976: T-M Analysis of Grade-Level Equivalent Scores of Third Grade 
Students in Total Reading. 



School 


Number of 
Cases 


Mean 


Standard 

Deviation T Value 


Degrees of 
Freedom 


Level of 
Significance 


Experimental Group 
Control Group 


42 
220 


2.54 
2.22 


.62080 n „p 
.65690 ^'^^ 


260 


.004 



Table 7. Bmlm Comparison Wh T-Test Analysis of Grade-Level-Kquivalent Scores of Third Grade 
Students in Total Reading. 



Number of Standard Degrees of Level of 

School Cases Mean Deviation T Value Freedom Significance 



Experimental Group 33 2.34 .46769 
Control Group 220 2.22 .65690 
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Table 8. Bmline Comparison J975; Mest Analysis of Gr^de-Level-fiquivalent Scores of Fourth Grade 
Students in Total Reading. 



0) 



Number of Standard Degrees of Level of 

School Cases Mean Deviation T Value Freedom Significance 

Experimental Group 40 3.23 1.0214 

Control Group 277 2.57 .73201 ^'^^ 



Table 9. BoseM Comparison J976: T-Test Analysis of Grade-Level-fiquivalent Scorn of Fourth Grade 
Students in Total Reading.** 





Number of 


Standard 


School 


Cases Mean 


deviation 


Experimental Group 


38 3.22 


.60887 


Control Group 


220 2.80 


.62335 



Degrees of Level of 
Freedom Significance 



3.88 256 



Table 10. BmM Comparison 1977; T-Test Analysis of Grade-LeveZ-£quivalent Scores of Fourth Grade 
Students in Total Reading. ** 



Number of Standard Degrees of Level of 

School Cases Mean Deviation T Value Freedom Significance 

Experimental Group 39 2.95 .88491 

Control Group 220 2.80 .62335 ^'"^ ^ -297 ji 

*Mcates a level of significance beyond the . OOJ level ~" 

**ControI group scores statistically created using S?SS in J976 and J977 J 
(See page 50 for eaiplanation) 
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Table 11. Baseline Comparison 197S; r-Test Analysis of Grade-Level-Equivalent Scores of Fifth Grade > 
Students in Total Reading, ]§ 





Number of 




Standard 


School 


Cases 


Mean 


Deviation 


Experimental Group 


27 


5.10 


.91586 


Control Group 


327 


3.41 


1.0866 



Degrees of Level of j* 
T Value Freedom Significance ^ 



7.81 352 .000* 



Table 12. BoseM Comparison J975; T-Test Mlysis of Grade-Level-Equivalent Scorn of Fifth Grade 
Students in Total Reading. 



Number of Standard Degrees of Level of 

School Cases Mean Deviation T Value Freedom Significance 



Experimental Group 24 5.66 1,5570 
Control Group 327 3.41 1.0866 



Table 13. BocsJjVi.^ Comparison 1977; T-Test / lalysis of Grade-Level-Equivalent Scores of Fifth Grade 
SJuden.. in Total Reading, 



Number of Standard Degrees of Level of 

S chool Cases M -an Deviation T Value Freedom Significance 



Experimeitc Gr ;up 29 ' 51 1.1130 . ... .... 

Control G; "i.n 327 \41 1.0866 ^'^^ '^"^ 



*fndicates dlml o' significonce he^^ni 'he . 001 level w 
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School 


Number of 
Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of 
Freedom 


Level of 
Significance 


Experimental Group 
Control Group 


23 
'276 


6.63 
4.16 


1.2385 
1.2110 


9.36 


297 


.000* 



Table 15, Boselitic Comparison 19?7.' T-Test Analysis of Grade-Level-Equivalenl Scores of Sirth Grade 
iludents m Total Reading, 



School 


Number of 
Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of 
Freedom 


Level of 
Significance 


Experimental Group 
Control Group 


21 
276 


5.72 
4.16 


1.2041 
1.2110 


5.70 


295 


.000* 



Table 16. Bmlm Comrim 1975; T-Test Analysis of Grade-lmHqmm Scorn of Second Grade 
Students in hrd Study Skills, 



Number of 
School Cases 


Mean 


Standard 

Deviation T Value 


Degrees of 
Freedom 


Level of 
Significance 


Experimental Group 44 
Control Group 215 


2.05 
2.43 


'^^^^^ -4 38 
.98210 ^'^^ 


196 


.000* 


"inaicares a imi oj signifmce beyond the .OOUml 
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Table 17. Bmline Comparison 1976; T-Test Analysis of Grade-Level-Equivalent Scores of Second Grade 
Students in Word Study Skills. 



Number of 
School Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of 
Freedom 


Level of 
Significance 


Experimental Group 31 
Control Group 215 


2.12 
2.43 


5.2645 
.98210 


-2.65 


65 


.010 


Table 18. Baseline Comparison 1977; T-Test Analysis of Grade-Level-Equivalent Scorn of Second Grade 
Students in Word Study Skills. 


Number of 
School Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of 
Freedom 


Level of 
Significance 


Experimental Group 25 
Control Group 215 


2.20 
2.43 


.30727 
.98210 


■1.13 


238 


.261 


Table 19. Baseline Comparison W5: T-Test Analysis of Grade-LeveHquivalent Scores of Second Grade 
Students in Comprehension SMs, 


Number of 
School Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of 
Freedom 


Level of 
Significance 


Experimental Group 44 
Control Group 215 


1.84 
2.05 


.46377 
.55827 


-2.28 


257 


.024 
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School 



Experimental Group 
Control Group 



Number of 
Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of 
Freedom 


Level of 
Significance 


31 
215 


1.86 
2.05 


.46377 
.55827 


-1.72 


244 


.087 



Table 21. Baseline CotnpaHson 1977; T-Test Amlysis of Gmde-LeveHqmalent Scores of Second Grade 
Students in Comprehmion Skills. 



School 


Number of 




Standard 




Cases 


Mean 


Deviation 


T Value 


Experimental Group 


25 


1.92 


.74593 


-.86 


Control Gnup 


215 


2.05 


.55827 



Degrees of Level of 
- '"icance 



27 .399 



Table 22. Baseline Compamn 1975; T-Test Analysis of Grode-Level-Equivalent Scorn of Third Grode 
Students in Word Study Skills. 



Number of standard Degrees of Level of 

^^^^^ ^^^ses Mean Deviation T Value Freedom Significance 



Experimental Group 54 2.51 .82379 

Control Group 220 2.24 .98428 ^'^^ '066 



Table 23. Baseline Comparison 1976; T-Test Analysis of Grade-Level-fiquivalent Scorn of Third Grade 
Students in Word Study Skills. 



Number of 
School Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of Level of 
Freedom Significance 


Experimental Group 42 
Control Group 220 


2.51 
2.24 


.61897 
.98428 


2.32 


86 .023 


Table 24. Baseline Comparison 1977; T-i. . 
Students in M Study Skills. 


analysis of Grade-Level-Equivalent Scores of Third Grade 


Number of 
School Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of Level of 
Freedom Significance 


Experimental Group 33 
Control Group 220 

y 


2.30 
2.24 


.52411 
.98428 


.58 


72 .564 



Table 25. Baseline Companson 1975; T-Test Mlysis of Grade-Level-Squivalent Scores of Third Grade 
Students in Comprehension Skills. 



Degrees of Level of 

School Hflfifls Mean uevianon i vaiue Freedom Significance 



Number of 




Standard 


Cases 


Mean 


Deviation 


54 


2.25 


.45753 


220 


2.25 


.66510 



Experimental Group 54 2.25 .45753 ^5 .971 

Control Group 



o 83 



84 



Table 26. Baseline Common 1976: r-Test Amlysis of Gmde-LeveHqMent Scores of Third Grade 
Students in Comi^irehension Skills, 



M 
O 



School 



Experimental Group 
Ccntrol Group 



Number of 




Standard 




Cases 


Mean 


Deviation 


T Value 


42 


2.63 


.81541 


3.22 


220 


2.25 


.66751 



Degrees of Level of 
Freedom Si^ificance 



260 



.001 



Table 27. Bmline Compmson 1911: r-Test Amlysis of Grade-leveHquinlent Scores of Third Grade 
Students in Comprehension Skills, 



Number of Standard Degrees of Level of 

School Cases Mean Deviation T Value Freedom Significance 



Experimental Group 33 2.45 .69769 
Control Group 220 2.25 .66751 



Table 28. Baseline Comparison 1975. T-Test Analysis of Grade-Level-Equivalent Scores of Fourth Grade 
Students in Word Study Skills, 





Number of 




Standard 




School 


Cases 


Mean 


Deviation 


T Value 


Experimental Group 


40 


3.28 


1.3394 


3.51 


Control Group 


277 


2.51 


.92013 



Degrees of Level of 
Freedom Significance ji 

ji 



.001 5 



Table 29. Baseline Comparison 1976; T-Test Analysis of Grade-Level Equivalent Scorn of Fourth Grade 
Students in Word Study Skills. ** 



Number of Standard Degrees of Level of 

MM Cases Mean Deviation T Value Freedom Significance 

Experimental ;>oup 38 3.61 1.3471 

Control Group 220 2.60 .94176 ^ 



Table 30. Baseline Comparison Wl: T-Test hmlysis of Grade-LeveHquivalent Scores of Fourth Grade 
Students in M Study Smis,** 



School 


Number of 
Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of 
Freedom 


Level of 
Significance 


Experimeiital Group 
Control Group 


39 
220 


2.93 
2.60 


.97795 
.94176 


2.00 


257 


.047 



Table 31. Baseline Comparison Mi T-Test Analysis of Grade-Level Equivalent Scores of Fourth Grade 
Students in Comprehension Skills. 



Number of Standard Degrees of Level of 

School Cases Mean Deviation T Value Freedom Significance 



Experimental Group 40 3.22 .79701 . 
Control Group 277 2.63 .75864 

♦Indicates a level of sifirnificance beyond the .001 level 
**Control group scores statistically created using SPSS in M and 1977 
(See page 50 for explmation) 
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Table 32. Baseline Compmon im: T-Test Amlysis of Grade-Level Eqmient Scorn of Fourth Grade 
Students in Comprehension Skills,** 



School 


Number of 
Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of 
Freedom 


Level of 
Significance 


Experirnentai Group 
Control Group 


38 
220 


3.13 
3.01 


.57313 
.62156 


1.04 


256 


.296 



Tjble 33. BaseUne Conpmon mii T-Test Analysis of Grade-Level-Equivalent Scores of Fourth Grade 
Siidents in Comprehension Skills.** 





Number of 




Standard 


School 


Cases 


Mean 


Deviation 


Experimental Groin 


39 


2.95 


.92560 


Control Group 


220 


3.01 


.62156 



Degrees of Level of 
Freedom Significance 



-.39 44 .701 



Table 34. Baseline Comparison 1975: Mest Mysis of Grade-leveHquivalent Scores of Fifth Grade 
Stu(^enti in ^ord Study sms. 



School 


Number of 
Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of 
Freedom 


Level of 
Significance 


Experimental Group 
Control Group 


27 
327 


4.52 
3.05. 


.85979 
1.2645 


8.17 


36 


.000* 



— »y V WW , wwm WW w-w-m r^w^wivw aw ■ w T W» 

g3 **Control group scms statistically created using SPSS in 1976 and 1977 

Q 'See page 50 for explanatfjn) qn 
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Table 35. Bmline C( npanson imi T-Test Analysis of Grade-Level-Equivalent Scores 0/ Fifth Grade > 
v.-udents in Word Study Skills. 



Number of Standard Degrees of Levelof J' 

School Cases Mean Deviation T Value Freedom Significance ^ 



Experimental Group 24 5.68 2,2154 . „. ,4 000* 

Control Group 327 3.05 1.2645 



Table 36. Baseline Comparison 1977: T-Test Analysis of Grode-Level-fiquivalent Scorn of Fifth 
Students in Word Study Skills. 



School 


Number of 
Cases 


Mean . 


Standard 
Deviation 


T Value 


Degrees of 
Freedom 


Levelof 
Significance 


Experimental Group 
Control Group 


29 
327 


4.51 
3.05 


1.0833 
1.2645 


5.18 


354 


.000* 



Table 37. Baseline Comparison 1975; T-Test Analysis of Grade-Level-fiquivolent Scorn of Fifth Grade 
Students in Comprehension Skills, 





Number of 




Standard 




Degrees of 


Level of 


School 


Cases 


Mean 


Deviation 


T Value 


Freedom 


Significance 


Experimental Group 


27 


5.39 


1.1832 


7.14 


352 


.000* 


Control Group 


327 


3.78 


1.1200 





*/ndicates a level 0/ significance beyond the .001 level 



o. 91 



92 



l^ufl ^T™". l'^''^ °f Grade-level-Bquivalent Scores of Fifth Grade 
Students m Comprehension Skills. ' 



School 



Experimental Group 
Control Group 



Number of 
Cases 

24 

327 



Mean 

5.67 
3.78 



Standard 
Deviation T Value 



1.4810 
1.1200 



6.11 



Degrees of 
Freedom 



25 



Level of 
Significance 



.000* 



Table 39. BoseM Comnmon 1911: T-Test Analysis of Grade-LeveI-£quivalent Soom of Fifth Grade 
Students m Comprehension Skills. 



School 



Experimental Group 
Control Group 



Number of 




Standard 




Cases 


Mean 


Deviation 


T Value 


29 


4.50 


1.5200 


2.46 . 


327 


3.78 


1.1200 



Degrees of Level of 
ficance 



31 



.020 



Table 40. Baseline Comparison I97S; Mest Analysis of Graie-level-Eqmvalent Scorn of Sixth Grade 
Students in Word Study Skills. 



School 


Number of 
Cases 


Mean 


Standard 
Deviation 


T Value 


Degrees of 
Freedom 


Level of 
Significance 


Experimental Group 
Control Group 


23 
276 

lift* 1 


6.83 
3.88 


1.0928 
1.1996 


11.41 


297 


.000* 



^RJC 



Table 11. Baseline Compoison W: T-Test Analysis of Gmde-heveHqumlent Scorn of Sixth Grade > 
Students in Word Study Skills. ig 

» 

Number of Standard Degrees of Level of « 

School Cases Mean Deviation T Value Freedom Significance 

Experimental Group 21 5.72 1.2041 . 

Control Group 276 4.16 1.2110 ^''^^ ' 



Table 72. Conmmi Comnm\ l-le^i km\^m of Grade-Level-Equivolent Scores of Second Grade 
Students in Total Reading. 



Number of Standard Degrees of Level of 

School Cases Mean Deviation T Value Freedom Significance 



Experimental Group 30 2.07 .54263 298 
Control Group 204 2.19 .52868 



Table 73. Concmenl Comparison; T-Test Analysis of Grade-Level-Equivalent Scorn of Third Grade 
Students in Total Reading. 



Number of Standard Degrees of Level of 

School Cases Mean Deviation T Value Freedom Significance 



Experimental Group 38 2.94 .84708 247 024 

Control Group 211 2.65 .68800 

♦Indicates a level of significance beyond the .001 level 

% 

o 

ERIC 



U1' 

% 



■ '» I III — - I 

. Number of 
School , Cases 


III 1 ^ lu 

Mean 


■ ^ 

Standard 

Deviation T Value 


Degrees of Level of 
Freedom Significance 


Experimental Group ' 11 
Control Group . ; 21^/ 

\ 

t 


3.10 ■ 
2.64 


•'57330 ■ ' . ' 
.75172' ' ^'^^ ' 


i 

. 21 .000* ■ 


. ^■ • ■. . " — ~ 

1 r 

Table 75/ Concumnt Comparison.' T-Test Analysis of Grade-Level-Equivalent Scores ofnftk Grade 
^ ' , ^^S^udents in Toia! Reading. ' - , 


■ • ' ' Number "of 
School . Cases ■ \ 


^Meah 


'Standard •. - 
Deviation .T Value 


.Degrees of Level of' 
Freedom ' Significance 


,v ■ 

Experimental Group 22 
Control Group ^ ' 362 . 


4.90 
3.43 

... ,, .. 


1.3951 ,jg' 
, .63052 


. - 1/ 

21 .000* 

t 



srr&r' '^-^^''^^sc^ of Sixth 



. ' Number of 
School Cases ' 


Mean 


Standard 

Deviation T Value 


Degrees of 
Freedom ■ 


' Level 'of 
Significance 


Experimental Group ' *21 
Control Group ' '237 


' 5.53- 
4.14^ ' 


^'^^^^ 5 46 
V .84209 ^'^^ 


• 22 

1 


.io.o* . 


i*uiuuicj) u imi oj signijicance oeyond the . m leve! . ' ' ' ■ — ^ 



= \ / 



7i 

R 

0' 



^6 



Table /??. Concurrent Comparison; T-TejJt Analysis of Grade-Lev^I-Squivatent ,Scor|e8 of Second Grade c» ' . • 
, ^ Students in Word Knowledge Skills. •, • ,'■ f ■ 



•., School 

.A ■ 


Number of 
Cas'es ' 


« 

% 


' Standard 
Deviation T Value 


, D|gree8of 
Freedom' 


' Level of 
^Significance 


Experimental Group 
Control Group 

• 


• 30 
204 . . 


2;09 


' .49810' ... 
•\ 74314 " '^'^^ ;, 

i 




.178' r 




Table 78. Commnl Comparison; T-Test Analysis of Grade-Level-Equivalent Scores of Second Grade 



. ■ Number of 
.V School' Cases 


Mean 


standard 
Deviation 


T Value 


' Degrees of 
Freedom 


Levtl of 
Significance 


Experimental Group 30 
Control Grout)' • 204 


■ 2,02 
2.14 : 


, .59678 • 

:3?>684 


-.97 

^ ji 


■47 

■ ' •■( 

■:' • ' ■ :'[}. 


.335 


■ ■ ■ ■ ^ . ... . ^J^--\ \ / 

» ■ ' • ■ 1 ' , / 

..'• •...'■ ."*''■ ■ ■,, ■ '■■/'■ . 
Table 79. Concurrent Qm^^rim, T-Test Analysis of Grade-Level-Equivalent Scores of Third'Gra'de 


Number of 
School Cases 


Mean 


Staifdard 
Deviation 


T Value 


Degrees of 

Freedom,' 

1 


Levflof . 
Sigpi^cance 


Experimental Group 38 

Control Groiip' 211 

1 . ■ 1 • • . ^ 

' ' 1 ' T— — 


• 2.78' 
2.58 


,73111 
.75877 - 


1.53 ' 


i , ■ 

• 247 ' 


1 t 

Vi2r 



i. \ 



ERIC 



100 



Table 81. Concurrent Colnpartjton; T-Test 'Analysis of Grade-Level-£quivalent\cores of Third Grade ' " ^ 



■ ' ; Number of- Standard Degrees of Level of 

^™ > .^^gs Mean Deviation T Value Ereodom , . Significance 



!E3?periinental Group 38i . ' 2.80 , 1.1686 * ' 

Ctotrol Group • 2.50 .81077 ^'^^ ' ^^ '^32 



Table 4)1, Concurrent Comparison; T-Test kUy&x^ of Grade-Level-Equivalent Scores of Fourth Qrade 
, Students in Word Knowledfire Skilte. ^' ' 



,, . .Number of. Standard ■ r , Degrees of Level of 

. .School Cases Mean Deviation ' T Vaiiie Freedom ^ Significance 

i : ; ^ ■ 

Experimental Group, 31 2.84 .53895 

■Control Group / 250 2.54 .64313 • ^'^^ ^'^ ■ ., 



Table 82„ Commnt Cor^pjnm: Mest Analysis of GMe-LrnHqumknt Scores of FouriK Grade 
iiudents. in Jieadmg Comprehemion. 



«5.hnni I!^^'' " u ' ^^^^^^ degrees of Level of 

school • Cases Mean Deviation ' T Value Freedoni . Signifi cance 

Experimental Group - 31' .3.29 75954 ' • ' ' - 

Control Group '250 .2.68 , .'91515 ^-^^ - 276 , .000* . 

"indipates a leveUf sismi/Jcance beyond the M level 



^ ' ' \ - ■ 102. 



Table 83. Concurrent Comparison; T-Test Mysis of Grade-lmHqvinknt Scores of Fifth Grade 
> . ' Students in H'brd Knowledge Skills. . . ' . 



School 


Number of 
. Cases 


Mean 


■ -.Ll.l.^ '■I-.iJl.U 

' Standard 
Deviation 


T Value 


. Degrees of 
; ' Freedom ■ 


Level of 
Significance 


t' 

Experimental Group ' 
Control Group 

* 


✓ 

• '22 
360 


■ 4.35' . 
'-3.15 


1.0401} 

.70603 

f' " ■ 


5.32 

f 


. " 22 


— s 

.000* 


Table 84. Concurmt Compamoni T-Tek Amlysis of GMe-lmHquMenl Scorn of Fi 
Students in Heading Comprehension. 


fth Grade 

1 

• 


" (, ■• . ♦ 

• . School 


Number of 
Cases 


^ Mean 


. Standard 
.Deviation' 


1 

T Value 


Degrees of 
Freedom 


Level of 
Significance 


'Experimental Group 
Control Group 

• ■ ' '' ' . 


22 
362 


, 5.40 ■ 
3.47 


1.6059 

.771\4 . 

■ ' I ■ 


. 5.74' 


21. 


.000* 


Table 85.'; Concvmnt J^okparim: T-Test Analyiis of Grade-Level-Equivalent Scores of Sixth Grade . 


School 


Number of " 
Cases / 


; ; Mean . . 


f:t Standard 
Deviation 


T Value 


Degrees of 
Freedom 


"Level of 
Significance 


JExperimental Group 
Control Group 


. 21 . 
■237: 


5.30 . 
4.22 


' .89581 . 
; 72265 


6.46 


256 


• . .000* 



•Indicates a level of signi/icance beyond the '. OOJ level 



"i"3: ; ; ■ ' ' , \ ' n 



Concurrent Cm^soni Mest Analysis of Gmde-Lml'Eqmdent Scores of Sixth Gme . 
Sments'in-^eading Comprehension. * - 



/School/ 


Number of 
Cases 


Afean 


■ .Standard 
Deviation 


T Value 


Degrees of 
Freedom ^ 


Level of 
Significance 


Experimental Group ■ 
Control Group 


21 
. 237 


5.97 . 
4.48 


1.1620 
■ 1.0670 


' 6.08 


, 256 . 


■ 

.000* ' 


Tabfe m. T-Test ^Analysis 0/ Grade-LeveHquivalent Scores of 'Second Grade SMer^Xs in Totol ' • 
^ — - ,,, ' ' • " ' 1 


School 

— - 


Number of 
Cases 


Mean 


Standard 
Deviation 


' T Value 


'Degrees of 
Freedom 


Level of 
Significance 


a 

ExMlrimental Group 
'^-Gefltrol Group 


■ 45' 
203 

f 


2.11 ..^ 
2.44 


' 0.568 • ; 
' 0.908 


-3.18 , 


/00.9 ■ 


.002 / 

1 


• _ - ■ . ••• ' , • . . , ' , ; 

Table'102. T-Test M^s\& of Grade-Level-Equivalenf Scores of Third Grade Studenis- in Totol' 

Arlt^unetic. • . * 


* 

School 


Number of 
Cases . 


Mean . 


Standard , 
Deviation ^ 


X T Value 


1 

Degrees of 
Freedom 

1 


Level of > • 
Significance 



Experimental Group 53 2.37 0.458 ' ' " ' 

Control Group 220"' '2.49; . 0.688 "^'^^ ' ^^^^ - . = '^^^ 

' . A 1 ■ • . 



Table' 103. T-Test Analysis of (jrode-Lev?P£qiiivo!eiit Scores of Fourth Grade Students in Total j 



thfnetic. .. ■ 1 . • /•• .. J. ^: 

9 

z 
a 

X 



School , ' 


'^I^UfflBer of 
Cases' 


Mean 


Standard 

Deviation ' T Value 


Degrees of 
•Freedom 


. — 

Level of 
Sijgnificance 

r 


Experimental Group 
Control Group . 


43 •. 
, 278 


3.29 
2.35 ^ 


0.668' •■ 

0.847 ■ ^'^^ : 


; 

3.19 ' 


'.001 . 

• 



Table 1 04; T-mt Analysis bf Grade-Level-Equivalent Scorn of Fifth Grade Students in Total 
■ Aritlmetic, . < 

■ / ' I^umber of ' , S'tand^d , Degrees of - Level of 

■ School . Cases Mean Devistion ' T Value, ^' . Freedom Significance 

Experimental Group , 27 « ■ 5.02 . ,0.696 . ...^ 

Cont?olGroup • y ,' 312 '3.84 1.004 ■ ^'^^ ^^'^ . 



r 



Table 105. T-Jest Analysis of Grad^Level-Equivalent Scores Of Second Grade skdm in Tml 
Arithmetic Coficepts. - 



School 



Number ofy 
Cases 


Mean 


.Standard 
Deviation 


T Value 


Degrees of 
Freedom 


Level of 
Significance 


^ 45 
203 


2.02' 

. 2,48 


0.621 ' 
1.0.34' 


-3.89 


V 106.0 


.000* 



.1 • ■■ 

Experimental Group 
.ControV Group' 



■ 1 



*/ndicates a level of sisfni/iconce beyond the .00] level ' -. ^ , ' 2 

' ■ ■ •■ ..'•■•7 ■ ■ . . ' •• ' /. ' ". ■ 



V 



- ' ' ^ n-i~"T I i_ 

' Number of , ; '.standard ' Deweesof -^^^ LpvpI nf 

s>cnool I tJases Mean Deviation 



Deviation vt Vdlue , Freedoiii , i Significance 

^Hxperimental Grbup 45. 2.33 ' 0.557 - • i "v 

iControl Group , . 203; 2.44 0.771 '^•'^ I 35.9 . .26'9 



Table 107. T-4t Analysis of GradHmHqidnlent Scores of TUrd Grade Students in Total 
Antmtic Concepts. . * ' ■ 



' :. ■ Number of standard Degrees of Level of 

' ' : . ^^^^^ ^^^^ ■ . i^ean , Deviation T Value Freedom ; Significance 

' ' ' ' " ' I I III 

Experimental Group 1 ' -W^. , 2.51 - 0.475 ■ 

. Controt Group . 226 \ 2.63 0.735 « "^-^^ . 277 .253 



Table 108. I-Test Analysis cf Gnie-lmhiqmaknt Scorn of Third Grade Studenls in ToM 
V inttoietic Computation; . ■, ' - 'X ', ' 



<;.hn.i • p"-"^ Standard ,; ■ Degrees of ' level of ^ 

__«__Ca3es : Mean Dkation lvalue , Fr^ , 'significance 

; Experimental Group 53 2.87 " 0.620 - ■ 

■.Control Group . . 266 ' 2.94 . "^'^^ 277 , .516. 



Table 109. T-^Test Analysis of Grade-Level-fiquivalent-pres of rTWrd Grade Students in Total • > 

, . ' '' j ••. • ' ' . ■ -D 

a 

X 



.'^umber bf j' / 


'^Standard 

Devifltlon 


T Value 


Degrees of fljljevel of - 
Freedom . Sitmificance 


Experiment^ Group ' , , 53 

Cbhtrql Group .2'66 : 2.30 

. :„■ . ■ '• : • ■ /■■ 


— ■■ V 

' 0.590 . 
0.842 


-1.97. 


?77 ^ .050 


•1 ■ ■ . . ■ . . 

• . ' ' . i ' 1 ' 

Table Ili.^.T-Test Analysis of Grade-Level-Bquivalent Scms of '^ourik Grade Students in Total 
. :^ Arithmetic Concepts.v ' ^ ^ . / ^ • 


< ' : • Number of 
• School . Cases ; Jean 


Standard 
Deviation 

4 


T Value 


Degrees of Level of 
Freedom' Significance 


Experimental Group'/ '43 3.50' 
Control Group . 278 * 2.95 

* .......... 


• 0.878 • 
0.961 


3.55 ' 


319 , .000* . 


" « « ' « ■ ' * ' \ ^ 

■ , Table- 111, T-Test Analysis of Grade-Level-Equivdlent Scores oihm\i Grade Students in Total . , 
, ■ " Arithmetic Computation. , ■ » ' • 


' . ' ' ; ' ■ ■ ■ ... 
■ '» ^ 9 fi ■ , Number of , , ; 

''School ' ■ Cases ' Mean 

h 1 


Standard 
, Deviation 


T Value 


Degrees of Level of 
Freedom _ Significance 


Experimental Group ,< 43 3.70 .. 
Conliol Group 278 - , 3.22 ' 


0.691. 
0.814 


3.65 


' 319 ' .000* 



Vikes a level of significance beyond Yhe'. 001 level : / "^^ • 



111- 



FRir , 



• ' Number of ' , sfandard . ' ■Deeress of 
Sehod C..es , Mean- De^fa t Value . • Si 




' Significance 



Experimental Group 43 • 3.04 • -ogss 
Control Group. ; . ' 278. 2!81 ; ■l.'o98 ' ' ^'^^ ' 66.7 - ".no 



Tsble 113. T-Test Analysis of Grade'lml-EqMent Scorn of Fifth Grade Students in Total ' 
A • Arithmetic Concepts, ' r 



Miber of ' . • Standard- ' \ Degi-eesof «of • 

School . pses Mean " ' • " 



Deviation T Value, ^Freedom Significance 
Experimental Group 21, ■ 5.00^ ' *0.898 • 

.Control Group, . 312 ~^^3.82' liM . ^'^^ .000* 



, . J., 



' . Table 11 4." T-Test Analysis^ of Grade-Level-Bquivalent Scores of fifth Grade Students <in Total ■ •, , ' 
' , . Arithmetic ^Computation. / . ^ ■ . 



0» 

it* 



J"' 



4 * ) ' 



•\ • ■ Number d ' Standard , Degrees of , , Level of ^ 

School ■ Gases ;/ Mean Deviatiqn . T Value '-Freedom '. 'Sigiiificaflce 

'■■ ' 'rr- ■ ■ ' ^ \ " . r ■ ■ . — ; ■■ ' ■ ' ,■ • 

.'Experimental Group Jr , 4.-86 '0.728, ... '/ . ■ 1 

Control Group ' ' 312 4.40 0.993 , ■ • . 4''' . ^ 

*Indicates a level of sicrnfficnncft hpvnnrf ^hp fl/)J » , , . ' .5 



Table 115. ; T-Test Analysis of Gmde-lmHquivalent Scpr^ul FiftJi Grade Siuienis in Total ^ 



p'; ' . • , Number of ^ ^ .Stahda^i ' '• Degrees of Level of I 

I School '. •' • Cases , Mean Deviation > • T Value Freedom Significance ^ 

■ ■ — -J — ^ — : — - — : . : ■ 0)' 

;yi:. ■ -.^ . ■ < . ■ ' ' [ 

' Experimental Group ■ 27 . 5.12 ■ .1.030 " '„ 

|i: . Control Group ■ . 312 3.42 U07.; i^'"' • ^ 

f: " *Indii;ates a level of significance beyond the . 001 level ~^ ' ~ ' " 



Table 116. Summary of Arimetic Dm The . 05 Level of SignifimceM OhHned or Was M omined 
for Each Comporison-Total AriMetic, AHMetic Concepts, Arithmetic Computotion, and 
AnMetic Application. 



Grade ' 


V Total 
Arithmetic'' 


_ Arithmetic 
' Concepts 


" Arithmetic 

Computation \ 


• Arithmetic 
Application 




" ' b 

. ./•yes 


■ y^s 


> . / 'no 




3 . 


V no 


'no , 


\ no 


yes^ 




yes^ " . 


• " yes^ ; 


' a ' ■ ■ ' 
yes 


no 




yes^ 


yes^ 


V yes^ „ : 


'a 
yes 



;(o}indicate8 the experimental- ^up mean was signi/tcantly higher ' ~ ' ' 

jj?) Indicates the control group mean was sig^^^ : * 

W This iftel of the test did not provi^ " J 

■r,': 115,'': -^^ V ■ . ■ . ,ll&^ : 




Ikh 

m 



86 



Table- 117 

gf^TOPESL-TMcarch 1975 



J^iiglish Structure 
Fourth Grade 



\ 



68% 



••••••■•I 

•••••• 

••••••••< 



••••••••I 



••••••••I 

••••••••I 

»•••••••• 



. ••••••• 

••••••••< 



:RP75 




Rock Point 



45%. 


r j ••••••••• 


«•••••••< ; 

••••••••« 

>•••••■•• J; ; t 

'••••••••4 {: i; 
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Af74 


. A< 74 
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/ 



Sixth Grade 
90% 




64% 




.68% 
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»••••••••< 


•««•••••< 
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Listemiig Comprehension 
Fburtlir' Grade 



Fifth Grade 



Sixth Grade 



88% 



ERIC 
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^•r'' Appendix B 




L. . 



lastemng Comprehension 
i^, ' ?burth XSrade Fifth Grade Sixth Grade 
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